Scribe: Transporting petabytes per hour - Engineering at Meta
By A Mystery Man Writer
Last updated 15 Jul 2024
![Scribe: Transporting petabytes per hour - Engineering at Meta](https://engineering.fb.com/wp-content/uploads/2019/10/CB19-046_Code_Blog_Scribe_Post_Hero-1.jpg)
Our hardware infrastructure comprises millions of machines, all of which generate logs that we need to process, store, and serve. The total size of these logs is several petabytes every hour. The o…
![Scribe: Transporting petabytes per hour - Engineering at Meta](https://engineering.fb.com/wp-content/uploads/2019/10/Sys@hero.jpg?w=580&h=326&crop=1)
Scribe: Transporting petabytes per hour - Engineering at Meta
Cedric Van Goethem on LinkedIn: Get a little glimpse of how we run systems @Scale at Facebook! Last year…
![Scribe: Transporting petabytes per hour - Engineering at Meta](https://mgrush.com/wp-content/uploads/2021/03/shutterstock_1844484457.png)
Facilitator's Glossary - MG Rush Facilitation Training and Meeting Design
![Scribe: Transporting petabytes per hour - Engineering at Meta](https://dl.acm.org/cms/asset/f72cee5f-e992-43f3-ac19-edee9911dfde/3470496.cover.jpg)
Understanding data storage and ingestion for large-scale deep recommendation model training
![Scribe: Transporting petabytes per hour - Engineering at Meta](https://engineering.fb.com/wp-content/uploads/2019/10/RIBgreenHero.jpg?w=580&h=326&crop=1)
Scribe: Transporting petabytes per hour - Engineering at Meta
![Scribe: Transporting petabytes per hour - Engineering at Meta](https://cdn.slidesharecdn.com/ss_thumbnails/facebookpaper-141019211915-conversion-gate01-thumbnail.jpg?width=640&height=640&fit=bounds)
Facebook Hadoop Usecase
![Scribe: Transporting petabytes per hour - Engineering at Meta](https://media.springernature.com/lw685/springer-static/image/chp%3A10.1007%2F978-3-030-41746-8_8/MediaObjects/493811_1_En_8_Fig1_HTML.png)
The IoT and Big Data Analytics for Smart Sustainable Cities: Enabling Technologies and Practical Applications
![Scribe: Transporting petabytes per hour - Engineering at Meta](https://pubs.acs.org/cms/10.1021/co200007w/asset/images/medium/co-2011-00007w_0008.gif)
Combinatorial and High-Throughput Screening of Materials Libraries: Review of State of the Art
Lohit Vijayarenu - Log Events @ Twitter: Challenges of Handling Billions of Events per Minute, Twitter, Twitter, data
Will petabytes ever become the norm in computer storage? If so, when? - Quora
![Scribe: Transporting petabytes per hour - Engineering at Meta](https://engineering.fb.com/wp-content/uploads/2019/08/hero_blue_2000x1125.png?w=580&h=326&crop=1)
Scribe: Transporting petabytes per hour - Engineering at Meta
![Scribe: Transporting petabytes per hour - Engineering at Meta](https://cdn.cms-twdigitalassets.com/content/dam/blog-twitter/engineering/en_us/infrastructure/2017/behind-twitter-scale/eng_infra_007.png.img.fullhd.medium.png)
The Infrastructure Behind Twitter: Scale
![Scribe: Transporting petabytes per hour - Engineering at Meta](https://image.slidesharecdn.com/bigdataandanalyticsbm-170507181418/85/big-data-and-analytics-9-320.jpg?cb=1667960846)
Big data and analytics
Recommended for you
You may also like