Презентация английский новая

1.

FORMAL PROBLEM STATEMENT OF
CONTEXT-AWARE SCREEN TEXT
TRANSLATION BASED ON MULTIMODAL
LEARNING
Гаврилов Д.А.
BMS
Москва, 17-19.02.2003
© Reshetnev Siberian State University of
Science and Technology, 2026
Author: Rau M.A.

2.

2
Presentation Plan
1. Introduction
2. Multimodal Concept
3. Problem with Traditional Methods
4. Proposed Solution
5. Key Idea
6. Conclusion and Future Work
© Reshetnev Siberian State University of
Science and Technology, 2026

3.

3
Contextual Screen Text Translation
© Reshetnev Siberian State University of
Science and Technology, 2026

4.

4
Limitations of Traditional Translation
Systems
1. Error propagation from OCR to translation
Short UI labels often mistranslated without
context
2. Loss of visual context after text extraction
© Reshetnev Siberian State University of
Science and Technology, 2026

5.

5
Model Architecture
© Reshetnev Siberian State University of
Science and Technology, 2026

6.

6
Conclusion and Future
Development
Conclusion
•Screen text translation is a multimodal task, not just
text processing
•Visual context (layout, icons, structure) is essential for
accurate meaning
Future Development
•Improve modeling of spatial relationships
•Handle dynamic interfaces
•Develop better evaluation methods
© Reshetnev Siberian State University of
Science and Technology, 2026