Commit

ballontranslator/data/*.png

ballontranslator/ui/pagesources/projects

release

.venv

ballontranslator/.venv

.idea

tmp.py

dummy_scripts.py

tmp

TEST*

ballontranslator/data/logs

*.json

.vscode

*.zip

*.ipynb

*.dll

*.docx

*.doc

 No newline at end of file

# Changelogs

### 2023-02-27

[v1.3.34](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.34) 发布

1. 修复繁体直排bug (#96)

2. 彩云和deepl目标语言支持繁体 (#100)

3. 支持读取.webp图片 (#85)

### 2023-02-23

[v1.3.30](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.30) 发布

1. 从PyQt5换到PyQt6以支持更好的嵌字预览, [避免PyQt5与nuitka的线程兼容性问题](https://github.com/Nuitka/Nuitka/issues/251)

2. 支持改变嵌字层透明度 (#88) 注意只是预览, 不会改变渲染结果, 嵌字透明度在右侧菜单效果里改

3. log文件写进data/logs

### 2023-01-27

[v1.3.26](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.26) 发布

1. 选中文本迷你菜单支持*聚合词典专业划词翻译*[沙拉查词](https://saladict.crimx.com): [安装说明](doc/saladict_chs.md)

<img src = "doc/src/saladict_doc.jpg">

2. 支持替换OCR和机翻结果中的关键字, 见编辑菜单或设置面板 [#78](https://github.com/dmMaze/BallonsTranslator/issues/78)

3. 支持拖拽导入文件夹 [#77](https://github.com/dmMaze/BallonsTranslator/issues/77)

4. 编辑文本时隐藏控制小方块 [#81](https://github.com/dmMaze/BallonsTranslator/issues/81)

5. 修Bug

### 2023-01-08

[v1.3.22](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.22) 发布

1. 支持删除并恢复被抹除文字

2. 支持角度复位

3. 修Bug

### 2022-12-30

[v1.3.20](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.20)发布

1. 适应具有极端宽高比的图片比如条漫

2. 支持粘贴到多个选中的文本编辑框

3. 修bug

4. OCR/翻译/修复选中文字区域, 填字样式会继承选中的文字框自己的

   单行文本建议选用ctc_48px, 多行日文选mangocr, 目前对多行其它语言不太行, 需要重新训练检测模型  

   注意如果用**ctc_48px**要保证框在竖排模式下且尽可能贴合单行文本

<img src="doc/src/ocrselected.gif" div align=center>

### 2022-11-29

[v1.3.15](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.15)发布

1. 修bug

2. 优化保存逻辑

3. 画笔现在可以改成方形(实验)

### 2022-10-25

[v1.3.14](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.14)发布

1. 修bug

### 2022-09-30

v1.3.13起支持深色模式: 视图->深色模式

### 2022-09-24

[v1.3.12](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.12)发布

1. 支持全局(Ctrl+G)/当前页(Ctrl+F)查找替换

2. 原来的文本编辑器局部撤销重做并入全局文本编辑撤销重做栈, 画板撤销重做现在和文本编辑分离

3. Word文档导入导出bug修复

4. 基于 https://github.com/zhiyiYo/PyQt-Frameless-Window 重写无边框窗口

### 2022-09-13

[v1.3.8](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.8)发布

1. 画笔工具修复及优化

2. 修正界面缩放

3. 支持添加自定义字体样式预设, 支持调整文字透明度和阴影, 详见https://github.com/dmMaze/BallonsTranslator/pull/38

4. 支持导入导出word文档, 支持打开*.json项目文件, 详见https://github.com/dmMaze/BallonsTranslator/pull/40

### 2022-08-31

[v1.3.4](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.4)发布

1. 添加离线日译英模型Sugoi Translator(仅日译英, 作者[mingshiba](https://www.patreon.com/mingshiba), 已获得集成授权), 感谢[@Snowad14](https://github.com/Snowad14)提供CT2转换模型

2. 来自[bropines](https://github.com/bropines)的俄语本地化支持

3. 文本编辑支持字距调节

4. 调整竖排符号及半角字符位置规则, 详见https://github.com/dmMaze/BallonsTranslator/pull/30

### 2022-08-17

[v1.3.0](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.0)发布

1. 修复DeepL翻译器的bug, 感谢[@Snowad14](https://github.com/Snowad14)

2. 修复部分字体偏小+轮廓导致看不清的问题

3. 支持**全局字体格式**(一键机翻字体格式): 在控制面板->嵌字菜单里将相应项从"由程序决定"改为"使用全局设置"后启用. 注意全局设置就是未编辑任何文本块时右侧字体格式面板的那些设置.  

4. 添加**新的修复模型**: lama-mpe (默认启用)

5. 文本块支持多选和**批量调整格式** (ctrl+鼠标左键或者按下右键拉框框选)

6. 支持日译英, 英译中的**自动排版**, 基于提取出的背景气泡, 目标语言为中文时会自动断句(基于pkuseg). 勾选设置面板->常规->嵌字->自动排版后将对一键机翻生效(默认启用). 

<img src="doc/src/multisel_autolayout.gif" div align=center>

<p align=center>

批量格式调整, 英译中自动断句分行

</p>

### 2022-05-19

[v1.2.0](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.2.0)发布

# Changelogs

### 2023-02-27

[v1.3.34](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.34) released

1. fix incorrect orientation assignment for CHT  (#96)

2. convert CHS to CHT if it is required for Caiyun & DeepL (#100)

3. support for webp (#85)

### 2023-02-23

[v1.3.30](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.30) released

1. Migrate to PyQt6 for better text rendering preview and [compatibility](https://github.com/Nuitka/Nuitka/issues/251) with nuitka

2. Support set transparency of lettering layer (#88)

3. Dump logs to data/logs

### 2023-01-27

[v1.3.26](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.26) released

1. Add support for [saladict](https://saladict.crimx.com) (*All-in-one professional pop-up dictionary and page translator*) in the mini menu on text selection. [Installation guide](doc/saladict.md) 

<img src = "doc/src/saladict_doc.jpg">

2. Support keyword substitution for OCR & machine translation results [#78](https://github.com/dmMaze/BallonsTranslator/issues/78): Edit -> ```Keyword substitution for machine translation```

3. Support import folder with drag&drop [#77](https://github.com/dmMaze/BallonsTranslator/issues/77)

4. Hide control blocks on start text editing. [#81](https://github.com/dmMaze/BallonsTranslator/issues/81)

5. Bugfix

### 2023-01-08

[v1.3.22](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.22) released

1. Support delete and restore removed text

2. Support reset angle

3. Bugfixes

### 2022-12-31

[v1.3.20](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.20) released

1. Adapted to images with extreme aspect ratio such as webtoons

2. Support paste text to multiple selected Text blocks.

3. Bugfixes

4. OCR/Translate/Inpaint selected text blocks

   lettering style will inherit from corresponding selected block.

   ctc_48px is more recommended for single line text, mangocr for multi-line Japanese, need to retrain detection model make ctc48_px generalize to multi-lines  

   Note that if you use **ctc_48px** make sure that the box is in vertical mode and fits as close to the single line of text as possible

<img src="doc/src/ocrselected.gif" div align=center>

### 2022-11-29

[v1.3.15](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.15) released

1. Bugfixes

2. Optimize saving logic

3. The shape of Pen/Inpaint tool can be set to rectangle (experimental)

### 2022-10-25

[v1.3.14](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.14) released

1. Bugfixes

### 2022-09-30

Support Dark Mode since v1.3.13: View->Dark Mode

### 2022-09-24

[v1.3.12](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.12) released

1. Support global Search(Ctrl+G) and search current page(Ctrl+F). 

2. Local redo stack of each texteditor are merged into a main text-edit stack, text-edit stack is split from drawing board's now. 

3. Word doc import/export bugfixes

4. Frameless window rework based on https://github.com/zhiyiYo/PyQt-Frameless-Window

### 2022-09-13

[v1.3.8](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.8) released

1. Pen tool bug fixes & optimization

2. Fix scaling

3. Support making font style presets, text graphical effects(shadow & opacity), see https://github.com/dmMaze/BallonsTranslator/pull/38

4. Support word document(*.docx) import/export: https://github.com/dmMaze/BallonsTranslator/pull/40

### 2022-08-31

[v1.3.4](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.4) released

1. Add Sugoi Translator(Japanese-English only, created & authorized by [mingshiba](https://www.patreon.com/mingshiba)): download the [model](https://drive.google.com/drive/folders/1KnDlfUM9zbnYFTo6iCbnBaBKabXfnVJm) converted by [@Snowad14](https://github.com/Snowad14) and put "sugoi_translator" in the "data" folder.

2. Add support for russian, thanks to [bropines](https://github.com/bropines)

3. Support letter spacing adjustment.

4. Vertical type rework & text rendering bug fixes: https://github.com/dmMaze/BallonsTranslator/pull/30

### 2022-08-17

[v1.3.0](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.3.0) released

1. Fix deepl translator, thanks to [@Snowad14](https://github.com/Snowad14)

2. Fix font size & stroke bug which makes text unreadable

3. Support **global font format** (determine the font format settings used by auto-translation mode): in config panel->Lettering, change the corresponding option from "decide by the program" to "use global setting" to enable. Note global settings are those formats shown by the right font format panel when you are not editing any textblock in the scene.

4. Add **new inpainting model**: lama-mpe and set it as default.

5. Support multiple textblocks selection & formatting. 

6. Improved manga->English, English->Chinese typesetting (**Auto-layout** in Config panel->Lettering, enabled by default), it can also be applied to selected text blocks use the option in the right-click menu.

<img src="doc/src/multisel_autolayout.gif" div align=center>

<p align=center>

batch text formatting & auto layout

</p>

### 2022-05-19

[v1.2.0](https://github.com/dmMaze/BallonsTranslator/releases/tag/v1.2.0) released

# BallonTranslator

简体中文 | [English](README_EN.md)  

简体中文 | [English](README_EN.md) | [Русский](README_RU.md) | [日本語](README_JA.md)

深度学习辅助漫画翻译工具, 支持一键机翻和简单的图像/文本编辑  

## 下载

[国内网盘](https://cowtransfer.com/s/b336741eec834b)  | [Google Drive](https://drive.google.com/drive/folders/1uElIYRLNakJj-YS0Kd3r3HE-wzeEvrWd?usp=sharing)

<img src="doc/src/ui0.jpg" div align=center>

  - 译文回填参考对原文排版的估计, 包括颜色, 轮廓, 角度, 朝向, 对齐方式等

  - 最后效果取决于文本检测, 识别, 抹字, 机翻四个模块的整体表现  

  - 支持日漫和美漫

  - 英译中, 日译英排版已优化, 文本布局以提取到的背景泡为参考, 中文基于pkuseg进行断句, 日译中竖排待改善

* 图像编辑  

  支持掩膜编辑和修复画笔

* 文本编辑  

  支持富文本编辑和一些基础排版格式调整

  - 支持所见即所得地富文本编辑和一些基础排版格式调整、字体样式预设

  - 支持全文/源文/译文查找替换

  - 支持导入导出word文档

* 适用于条漫

# 说明

# 使用说明

## 一键翻译

**建议在命令行终端下运行程序**, 首次运行请先配置好源语言/目标语言, 打开一个带图片的文件夹, 点击Run等待翻译完成  

<img src="doc/src/run.gif">  

### 发布版

Windows用户可从[MEGA](https://mega.nz/folder/gmhmACoD#dkVlZ2nphOkU5-2ACb5dKw) or [Google Drive](https://drive.google.com/drive/folders/1uElIYRLNakJj-YS0Kd3r3HE-wzeEvrWd?usp=sharing)(注意: 需要从github release 下载最新版Ballonstranslator-1.3.xx, 解压并覆盖到**Ballontranslator-1.3.0-core**或者较旧的安装目录以更新程序.)

### 运行源码

```bash

# 确保python<=3.9

$ python --version

# 克隆仓库

$ git clone https://github.com/dmMaze/BallonsTranslator.git ; cd BallonsTranslator

# 安装依赖, macOS安装requirements_macOS.txt

$ pip install -r requirements.txt

```

如果有N卡可以安装torch-cuda启用GPU加速: 

```bash

pip install torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/cu116

```

从 [MEGA](https://mega.nz/folder/gmhmACoD#dkVlZ2nphOkU5-2ACb5dKw) or [Google Drive](https://drive.google.com/drive/folders/1uElIYRLNakJj-YS0Kd3r3HE-wzeEvrWd?usp=sharing) 下载**data**文件夹并移动到 ```BallonsTranslator/ballontranslator```目录, 最后运行

```bash

python ballontranslator

```

如果要使用Sugoi翻译器(仅日译英), 下载[离线模型](https://drive.google.com/drive/folders/1KnDlfUM9zbnYFTo6iCbnBaBKabXfnVJm), 将 "sugoi_translator" 移入BallonsTranslator/ballontranslator/data/models.  

### Apple Silicon Mac 本地构建.app应用

```

# 安装Python 3.9.13虚拟环境

brew install pyenv mecab

env PYTHON_CONFIGURE_OPTS="--enable-shared" pyenv install 3.9.13

pyenv global 3.9.13

python3 -m venv ballonstranslator

source ballonstranslator/bin/activate

# 克隆仓库

git clone https://github.com/dmMaze/BallonsTranslator.git

cd BallonsTranslator

### 一键翻译结果预览

|                                          Original                                           |         Translated          |

| :-----------------------------------------------------------------------------------------: | :-------------------------: |

|        ![Original](ballontranslator/data/testpacks/manga/original2.jpg 'https://twitter.com/mmd_96yuki/status/1320122899005460481')         | ![Output](doc/src/result2.png) |

| ![Original](ballontranslator/data/testpacks/manga/original4.jpg 'https://amagi.fanbox.cc/posts/1904941') | ![Output](doc/src/result4.png) |

| ![Original](ballontranslator/data/testpacks/manga/AisazuNihaIrarenai-003.jpg) | ![Output](doc/src/AisazuNihaIrarenai-003.png) |

|           ![Original](ballontranslator/data/testpacks/comics/006049.jpg)           | ![Output](doc/src/006049.png) | 

|           ![Original](ballontranslator/data/testpacks/comics/006058.jpg)           | ![Output](doc/src/006058.png) | 

# 安装依赖

pip3 install -r requirements_macOS.txt

# 打包应用

cd ballontranslator

sudo pyinstaller __main__.spec

# 打包好的`BallonsTranslator.app`在`dist`文件夹下

# 需要注意的是，现在的应用还无法使用，需要到 [MEGA](https://mega.nz/folder/gmhmACoD#dkVlZ2nphOkU5-2ACb5dKw) 或者 [Google Drive](https://drive.google.com/drive/folders/1uElIYRLNakJj-YS0Kd3r3HE-wzeEvrWd?usp=sharing) 下载`data`并覆盖到`BallonsTranslator.app/Contents/Resources/data`, 覆盖的时候选择“合并”，覆盖完成后应用最终打包完整，开箱即用，将应用拖到macOS的应用程序文件夹即可，不需要再配置Python环境。

```

## 一键翻译

**建议在命令行终端下运行程序**, 首次运行请先配置好源语言/目标语言, 打开一个带图片的文件夹, 点击Run等待翻译完成  

<img src="doc/src/run.gif">  

一键机翻嵌字格式如大小、颜色等默认是由程序决定的, 可以在设置面板->嵌字菜单中改用全局设置. 全局字体格式就是未编辑任何文本块时右侧字体面板显示的格式:  

<img src="doc/src/global_font_format.png"> 

## 画板

文本编辑

</p>

<img src="doc/src/multisel_autolayout.gif" div align=center>

<p align=center>

批量文本格式调整及自动排版

</p>

<img src="doc/src/ocrselected.gif" div align=center>

<p align=center>

OCR并翻译选中文本框

</p>

## 界面说明及快捷键

* Ctrl+Z, Ctrl+Y可以撤销重做大部分操作，注意翻页后撤消重做栈会清空

* A/D翻页, 如果当前页面未保存会自动保存

* A/D或pageUp/Down翻页, 如果当前页面未保存会自动保存

* "T"切换到文本编辑模式下(底部最右"T"图标), W激活文本块创建模式后在画布右键拉文本框

* "P"切换到画板模式, 右下角滑条改原图透明度

* 底部左侧"OCR"和"A"按钮控制启用/禁用OCR翻译功能, 禁用后再Run程序就只做文本检测和抹字  

* 设置面板配置各自动化模块参数

* Ctrl++/-或滚轮缩放画布

* Ctrl+A可选中界面中所有文本块

* Ctrl+F查找当前页, Ctrl+G全局查找

<img src="doc/src/configpanel.png">  

## 自动化模块

# 自动化模块

本项目重度依赖[manga-image-translator](https://github.com/zyddnys/manga-image-translator), 在线服务器和模型训练需要费用, 有条件请考虑支持一下

- Ko-fi: <https://ko-fi.com/voilelabs>

- Patreon: <https://www.patreon.com/voilelabs>

- 爱发电: <https://afdian.net/@voilelabs>

Sugoi翻译器作者: [mingshiba](https://www.patreon.com/mingshiba).

### 文本检测

暂时仅支持日文(方块字都差不多)和英文检测, 训练代码和说明见https://github.com/dmMaze/comic-text-detector

### 翻译器

 * 谷歌翻译能挂代理建议把url从cn改成com

 * <s>谷歌翻译能挂代理建议把url从cn改成com</s> 谷歌翻译器已经关闭中国服务, 大陆再用需要设置全局代理, 并在设置面板把url换成*.com

 * 彩云, 需要申请[token](https://dashboard.caiyunapp.com/)

 * papago  

 * DeepL 和 Sugoi(及它的CT2 Translation转换)翻译器, 感谢[Snowad14](https://github.com/Snowad14)  

 如需添加新的翻译器请参考[加别的翻译器](doc/加别的翻译器.md), 本程序添加新翻译器只需要继承基类实现两个接口即可不需要理会代码其他部分, 欢迎大佬提pr

## 杂

* 发布包包含pytorch和cuda所以那么大. 以后更新如果依赖库不做变动, 就只发布本体二进制/新配置文件/新模型, 下载后覆盖旧版本

* 如果电脑带N卡, 程序默认对所有模型启用GPU加速, 默认配置下显存占用在6G左右. 4G显存调小修复器inpaint_size即可.  

# TODO

- 支持更多语言的OCR模型

- ...

* 感谢[bropines](https://github.com/bropines)提供俄语翻译

* 第三方输入法可能会造成右侧编辑框显示bug, 见[#76](https://github.com/dmMaze/BallonsTranslator/issues/76), 暂时不打算修

* 选中文本迷你菜单支持*聚合词典专业划词翻译*[沙拉查词](https://saladict.crimx.com): [安装说明](doc/saladict_chs.md)

## 一键翻译结果预览

|            Original            |         Translated (CHS)         |         Translated (ENG)         |

| :-----------------------------------------------------------------------------------------: | :-----------------------------------------------------------------------------------------: | :-----------------------------------------------------------------------------------------: |

|![Original](ballontranslator/data/testpacks/manga/original2.jpg 'https://twitter.com/mmd_96yuki/status/1320122899005460481')| ![Translated (CHS)](doc/src/result2.png) | ![Translated (ENG)](doc/src/original2_eng.png) |

|![Original](ballontranslator/data/testpacks/manga/original3.jpg 'https://twitter.com/_taroshin_/status/1231099378779082754')| ![Translated (CHS)](doc/src/original3.png) | ![Translated (ENG)](doc/src/original3_eng.png) |

| ![Original](ballontranslator/data//testpacks/manga/AisazuNihaIrarenai-003.jpg) | ![Translated (CHS)](doc/src/AisazuNihaIrarenai-003.png) | ![Translated (ENG)](doc/src/AisazuNihaIrarenai-003_eng.png) |

|           ![Original](ballontranslator/data//testpacks/comics/006049.jpg)           | ![Translated (CHS)](doc/src/006049.png) | |