Capturing Visual Context

Manual Upload of Image Context

Visual Context helps Translators make linguistic, layout, and spacing decisions based on where strings appear in on your website, mobile or desktop application.

For non-web content such as mobile or desktop applications, image files, such as screenshots, can be uploaded and associated with source strings to provide visual context.

Smartling now supports video as a convenient way to provide screenshots for translators. For more information, see the Context from Video article.

If your content can be viewed in a browser, it may be preferable to capture dynamic context with the JS Context Capture Library, or by using the Chrome Context Capture Extension.

Optical Character Recognition

Smartling uses OCR (Optical Character Recognition) to automatically match the text in images to strings in your project. You can review and improve context after the automatic recognition has taken place (see steps 3-5 above).

For OCR to work, make sure your source content (strings) have been uploaded to Smartling before you upload your screenshot.

The Image Context API can be used to automate the upload of context images. Unfortunately, image context is not dynamic, and will not display the translated text the same way as HTML context. In other words, if the length of your translated text is longer or shorter than the original text on the site, your translated text won't automatically scale/adjust to the allotted space on the site.

Add Screenshots to Your Content

  1. Do one of the following:
    • In the New Experience, from a project, click the Context tab and then click Image Context
    • In the Classic Experience, go to Projects > Content > Image Context
  2. Click Upload Files. Drag and drop images directly onto the page or browse for files to upload. You can add a single file or multiple files at once. 
    • You can select up to 100 files with a size limit of 10MB per file.
    • Context files are processed one at a time for any string matches within the project.
  3. Once each file has finished processing, you can click the context file and review the strings that were automatically mapped to the context by OCR.
    • You can remove any strings mapping by clicking the X on the string match
  4. To manually map strings with context, click and drag your pointer on the image. 
  5. Type the string in the text box and select the corresponding source string from your content list.
    • The context will be applied to that string(s) in the CAT Tool (not the entire job).

Add Screenshots to Your Strings (New Experience)

To add context to your strings with images: 

  1. Click the Strings tab. 
  2. Select the checkbox next to the strings(s) you want to add context to. 
  3. Click Actions and select Add Context.
  4. In the dialog that appears, click Browse and select the .png or .jpeg image to add. 
  5. Click Add Context. The updated context will be visible in the CAT tool. 

Add Screenshots to Your Strings (Classic)

 You can add context to your string(s) by doing the following:

  1. Go to Jobs > select a job > View all strings.
  2. Select your string(s) and click Actions > Add Context, then upload your context (.jpg or .png files).
    • If you had previous context for those strings, it will be overwritten with the new context.
    • If some strings are not recognized, it's also possible to add context manually on the context page.

When you launch the CAT tool, you'll see your uploaded context for your string(s).

Troubleshooting OCR

Occasionally, OCR may not map strings automatically. There can be a number of reasons why the OCR has not worked as intended. Here are some tips on why OCR may not work;

  • The image is of poor quality / small size file
  • The image contains unusual fonts
  • The image is missing some terms that are included in the string
  • The image contains special characters that are not included in the string
  • The image contains text that is blurry or small
  • The string is too long

Here are some tips to ensure Visual Context is mapped correctly;

  • Ensure the image is high quality and focused.
  • Ensure the image and string contains the same text, in a standard font, with no special characters
  • Always check the Context tab to ensure the strings have been mapped correctly and remove any mismatched strings
  • Manually map any unmapped strings to ensure Visual Context for Translators




Was this article helpful?