New Vision-Language Solution for Extracting Tables and Figures from PDFs
As researchers and technical writers, we often find ourselves sifting through countless research papers, trying to extract the most relevant information to include in our own work.
One of the most time-consuming and challenging tasks in this process is identifying and extracting the tables and figures from these papers. Traditional methods of manually combing through PDFs or using basic text extraction tools often fall short, leaving us frustrated and wishing for a more efficient solution.
Fortunately, the recent advancements in computer vision and natural language processing have given rise to a new and powerful tool that can significantly improve the way we approach this problem.
The new solution
Introducing the TF-ID (Table/Figure Identifier) model, a fine-tuned vision language model that can do a much better job detecting and extracting tables and figures from research papers with remarkable precision, comparing with previous methods.
![image/png image/png](https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F256d1b64-a64a-4bcc-9a72-d0a3498b5f64_737x987.png)
The TF-ID model is built upon the foundation of a pre-trained vision-language model called Florence-2, which was recently released by Microsoft. This powerful model has been fine-tuned by the researcher to specialize in the task of identifying tables and figures in academic papers. What sets TF-ID apart from other existing solutions is its ability to not only โฆ
Curious to delve deeper into this?
Join Professor Mehdi and myself for a deep-dive discussion about this new approach:
๐
What You'll Learn:
๐ The very practical python library that you can use to achieve the goal.
๐ Walk through of the Colab code that does the job!
๐ Use cases, branding, and our new product launch!
Stay tuned as we continue exploring the development of knowledge-augmented AI systems to extract maximum value from unstructured data sources!
๐ ๏ธโจ Happy practicing and happy building! ๐๐
Thanks for reading our newsletter. You can follow us here: Angelinaย Linkedin or Twitter and Mehdi Linkedin or Twitter.
๐ฆ Any specific contents you wish to learn from us? Sign up here: https://noteforms.com/forms/twosetai-youtube-content-sqezrz
๐งฐ Our video editing tool is this one!: https://get.descript.com/nf5cum9nj1m8
๐จ Implementation: https://github.com/ai8hyf/TF-ID
HF: https://huggingface.co/yifeihu/TF-ID-base
ย ๐ Also if you'd like to learn more about RAG systems, check out our book on the RAG system:
๐ฌ Don't miss out on the latest updates - Subscribe to our newsletter: