DeTikZify simplifies the creation of scientific figures by automatically generating TikZ graphics programs from sketches and existing figures. The innovative multimodal language model uses an MCTS-based inference algorithm for refining outputs without extra training. Users facing installation and inference difficulties can access the Hugging Face Space or Google Colab demo. The Python package can be easily installed via pip. DeTikZify requires a full TeX Live 2023 installation and additional dependencies. The web UI offers interactive use, while more complex examples can be found in the examples folder. Model weights and datasets are available on the Hugging Face Hub, with acknowledgments to LLaVA and VerMCTS for inspiration. Note: portions of the DaTikZv2 dataset had to be removed due to licensing restrictions.
https://github.com/potamides/DeTikZify