July 20, 2021
The Architecture
![](http://armando.ws/wp-content/uploads/2021/07/jor_el_high_level_ingestion.png)
I started off by drawing plans on how to architect the Text Processor Engine (TPE) and realized I had to take several steps back and understand how the system as a whole would work. In the middle of that exercise I realized the TPE would not scale and wasn’t a very good path forward. I