Administration
    1. Help Center | Memsource
    2. Settings & Subscription
    3. Administration

    Kibana—Analytics Data Visualization Workbench

    Available for

    • Ultimate and Enterprise editions

    Get in touch with Sales for licensing questions.

     

    Memsource users are able to visualize data from their accounts through Kibana, an open-source data visualization workbench. Kibana allows you to visualize and explore all data indexed by our analytics data warehouse, and there is an almost endless number of queries that can be visualized using Kibana.

    Kibana version 4.1.11 is required to process data from Memsource.

    Data Types That Can be Visualized

    All visualizations created in Kibana can also be turned into CSV based tables containing the hard data behind.

    Some examples of data indexed through Kibana:

    • Project

      Project creation date, last modification, created by, last modified by, source language, target languages, project settings, client, domain, subdomain, business unit, project status, due date, etc.

    • Jobs

      Job creation date, last modification, created by, last modified by, source language, target language, assigned to linguist/vendor, due date, workflow step, file type, etc.

    • Analyses

      Total wordcount, net wordcount, translation memory matches, machine translation matches, etc.

    • Costs

      Costs per project, project margin, etc. (based on Price Lists).

    • API

      Summary of API usage, list and breakdown of API calls per period of time, etc.

    • Time Tracking

      Collection of time-tracking stats (in ms) follows these principles and can be seen in both MXLIFF files and in Kibana:

      Time_Tracking.png

      • User clicks into segment #1:

        • Counting of segment #1 thinking time starts

        • Counting of segment #1 editing time starts

      • User starts editing segment #1:

        • Counting of segment #1 thinking time is stopped

        • Counting of segment #1 editing time continues

      • User clicks into segment #2:

        • Counting of segment #1 editing time is stopped

      • When a user re-enters segment #1, the counting starts again and the new times are added to the previous values. If edited upon re-entering, both times are updated. If there is no editing, times are not updated.

      • The thinking and/or editing times are measured for each workflow step separately.

      To reach time tracking, use the com.memsource.web.analytics.data.jobpart index in fields data.editing.*.You may need to refresh the jobpart index in the Kibana settings page for Kibana to learn of the existence of these new fields.

    Memsource Installation Steps

    1. From the Settings Setup_gear.png page, scroll down to the Analytics & Reporting section and click on Kibana.

      The Kibana Access page opens.

    2. Copy the unique Kibana URL.

     

    Kibana Installation Steps

    1. Open the kibana.yml configuration file from Kibana config subfolder.

    2. Replace elasticsearch_url value (usually http://localhost:9200) with the URL generated in the Memsource steps.

    3. Ensure the kibana_index value is set to .kibana

    4. Save the kibana.yml file.

    5. Start Kibana from the the Kibana bin subdirectory.

      • Windows: double-click kibana.bat

      • Other O/S: double-click kibana (other users).

    6. Verify setup.

      The following is visible in the command prompt window:

      Kibana_Connected.png

    7. Enter localhost:5601 into the address bar of a browser to access the visualization workbench.

    Important

    The command prompt window must stay open to maintain the connection to Kibana.

     

    Kibana Configuration

    Index patterns are required for visualization and are applied in Settings under the Indices menu. The following index patterns are currently available:

    • com.memsource.web.analytics.data.job (job.dateCreated)

    • com.memsource.web.analytics.data.jobpart (jobPart.dateCreated)

    • com.memsource.web.analytics.data.analysis (jobPart.dateCreated)

    • com.memsource.web.analytics.data.costs (jobPart.dateCreated)

    • com.memsource.web.analytics.data.lqa (lqa.dateCreated)

    When creating indexes, the expression in brackets represent the recommended Time-field name for the given index. Any or all of the indexes available can be configured.

    Once the indexes are registered, data can be visualized through the Visualize tab.

     

    Index Classifications

    Job index

    • Contains information about job sizes (words, pages etc.), who created the jobs, when they were created, filetypes, projects, and organizations they belong to.

    Job Part index

    • Jobs themselves do not have statuses or assigned users. This type of information is stored in terms of job parts (i.e. jobs in different workflow steps constitute different job parts). Otherwise, the same of data as in the Job index are available (filetype, project, organization etc.).

    Analysis index

    • Information about Analyzed Job Parts (divided into match categories) with and without Net Rate applied.

    Costs index

    • Costs for the Job Part (based on Price Lists).

    API index

    • Summary of API usage.

    LQA index

    • Breakdown of LQA evaluations entered for Job Parts based on defined categories, subcategories and severity.

     

    Kibana Configuration Examples

    These examples use a Vertical Bar Chart, which is the most versatile type of graph Kibana offers. The examples include an Index specification (which index should be chosen). If no results appear, ensure the selected time period is correct.

    Most Translated Language Pairs

    Top_5_language_pairs.png

    Configuration:

    • Index

      analytics.data.job

    • Metrics

      Sum of data.volume.words

    • Buckets

      X-Axis - Terms - job.languagePair

    Configuration_Top_5.png

    Most Expensive Projects

    10_most_expensive_projects.png

    Configuration:

    • Index

      analytics.data.costs

    • Metrics

      Sum of data.total

    • Buckets

      X-Axis - Terms - project.id

    Configuration_most_expensive_projects.png

    Costs Per Linguist

    Costs_per_linguist.png

    Configuration:

    • Index

      analytics.data.costs

    • Metrics

      Sum of data total

    • Buckets

      X-Axis - Terms - jobPart.assignedTo.linguist.fullName.untouched

    • Filter

      quote.tags:"com.memsource.costs.jobPart.raw"

      Creates a chart without NetRate applied.

    • Filter

      quote.tags:"com.memsource.costs.jobPart"

      Creates a chart with NetRate applied.

    Configuration_Linguist_without_NetRate.png

    Costs Per Vendor

    Costs_per_vendor.png

    Configuration:

    • Index

      analytics.data.costs

    • Metrics

      Sum of data total

    • Buckets

      X-Axis - Terms - jobPart.assignedTo.vendor.token

    • Filter

      quote.tags:"com.memsource.costs.jobPart.raw"

      Creates a chart without NetRate applied.

    • Filter

      quote.tags:"com.memsource.costs.jobPart"

      Creates a chart with NetRate applied.

    Configuration_Vendor.png

    Expected Wordcount vs. Net Number of Words

    Expected_vs_Real.png

    Configuration:

    • Index

      analytics.data.analysis

    • Metrics

      Sum of data.total.words

    • Buckets

      X-Axis - Terms - jobPart.assignedTo.linguist.fullName.untouched

    • Split bars

      Sub Aggregation - Filters

      • Filter 1

        analysis.tags:"com.memsource.analysis.jobPart.raw"

      • Filter 2

        analysis.tags:"com.memsource.analysis.jobPart"

    Configure_Expect_vs_Real.png

    Monthly TM Leverage

    Monthly_TM_Leverage.png

    Configuration:

    • Index

      analytics.data.analysis

    • Metrics

      Sum of data.tm.match.101.words

      Enter any match rates from the list

    • Buckets

      X-Axis - Date Histogram - Monthly

    Configuration_TM_Leverage.png

    Projects Created Monthly

    Kibana_projects_per_month_graph.png

    Configuration:

    • Index

      analytics.data.job

    • Metrics

      Unique Count of project.id

    • Buckets

      X-Axis - Date Histogram - project.dateCreated - Monthly

    Kibana_projects_per_month_settings.png

    Projects Created in Specific Month Sorted by PM

    Kibana_projectsPM_in_month_graph.png

    Configuration:

    • Index

      analytics.data.job

    • Metrics

      Unique Count of project.id

    • Buckets

      X-Axis - Date Range - project.dateCreated - dates (in form YYYY-MM-DD)

    • Split charts

      Sub Aggregation - Tems

    • Field

      job.createdBy.fullName.untouched

    • Order

      Top - 0

    • Orderby

      metric: Unique count of project.id

    Kibana_projectsPM_in_month_graph_settings.png

    Report by LQA category and severity

    Kibana_projectsLQA_category_and_severity.png

    Configuration:

    • Index

      analytics.data.lqa

    • Metrics

      Count

    • Buckets

      X-Axis - Terms - lqa.category.name

    • Split bars

      Sub Aggregation - Terms - lqa.severity.name

    LQA_category_and_severity.png
     
     
    Was this article helpful?

    Sorry about that! In what way was it not helpful?

    The article didn’t address my problem.
    I couldn’t understand the article.
    The feature doesn’t do what I need.
    Other reason.

    Note that feedback is provided anonymously so we aren't able to reply to questions.
    If you'd like to ask a question, submit a request to our Support team.
    Thank you for your feedback.

    Articles related to Administration