![[cover image] data structure of PageContainer (image credit: Jian Zhong)](https://jianzhongdev.github.io/VisionTechInsights/images/page_container_direct_data_io/PageContainerDataStructure.png)
PageContainer: Fast, Direct Data I/O Without OS Buffering
When creating high-speed data streaming applications, it’s important to avoid unnecessary data transfer to keep things fast and efficient. Operating systems (OS) automatically buffer file input/output (I/O) in the computer’s memory. However, many data streaming applications already have their own buffering steps, making the OS’s additional buffering unnecessary. Disabling this OS buffering allows direct control of data transfer, but it requires the application to access data in sizes that are multiples of the system page size (or disk sector size)....