• Hungry Minds
  • Posts
  • 🍔🧠 Scaling for Billions: Uber's Data Ingestion Powerhouse

🍔🧠 Scaling for Billions: Uber's Data Ingestion Powerhouse

PLUS: Nvidia Beats Apple 😲, How to Scale Databases ⚡, Load Balancing Crash Course 👨🏻‍🎓

Author

Alex Zajac
June 10th, 2024

Happy Monday! ☀️

Welcome to the 1777 new hungry minds who have joined us since last Monday!
If you aren’t subscribed yet, join smart, curious, and hungry folks by subscribing here.

🍔 THIS WEEK’S MENU 🥗

  • 📚 How Uber tracks billions of trips, 4 software design principles learned the hard way, UML class diagrams explained.

  • 🗞️ Nvidia becomes the second most valuable company, Microsoft's AI-powered recall feature sparks cybersecurity concerns, and scientists develop ultra-thin batteries charged by tears.

  • 👨🏻‍💻 Quick byte: Zustand - simple state management library for React applications.

Reading time: 5 minutes

Food for Thought
A mindset, an example, and an action item to start the week
❝

"Code is like humor. When you have to explain it, it’s bad."

Cory House

Mindset: Simplicity and elegance are hallmarks of great code, just as conciseness is key to effective humor - both should be self-explanatory.

Example: Apple's legendary focus on user experience stems from its commitment to clean, intuitive design and code that "just works."

Action Item: Refactor a small section of your codebase today, striving for clarity and removing any unnecessary comments or convoluted logic.

The Rabbit Hole
Deep dives, trends, and resources curated to stay ahead

How Uber Tracks Billions of Trips

We'll talk about Apache Pinot, Bloom Filters, Inverted Indices, and more. Plus, how to manage your motivation as a solo developer and why you should job switch.

UML Class Diagram Explained with Examples

#15 Object Oriented Design - UML Class Diagram

What distinguishes a great software engineer?

What we can conclude from two research papers on this topic by Microsoft

Senior Engineer to Lead: Who to promote and how to train them

Overview of the insights from the roundtable on Plato Elevate conference in San Francisco!

4 Software Design Principles I Learned the Hard Way

If there’s two sources of truth, one is probably wrong. And yes, please repeat yourself.

LUC #56: How to Approach Scaling Your Database

Plus, how the most prominent Git branching strategies work, HTTPS workflow explained, and how do you decide which database type

How to choose between batch, micro-batch, and streaming when building a data pipeline

Speed is all the rage in data engineering nowadays. Stakeholders want their data sooner with higher quality and efficiency! All this demand for speed can cause data engineers to make stupid decisions by not asking the proper follow up questions to decipher the true requirements from the false ones!

Why I Switched Teams

IG Media Infra -> AI/ML Training Infra

💾 SIDE DISHES 💾

ARTICLE (we love cookies)
Demystifying cookies and tokens

GITHUB REPO (open-courses-ai)
Microsoft’s free courses on generative AI

COURSE (balance that load)
Load balancing crash course

ARTICLE (calvin harris in html)
How deep is your DOM?

The Weekly Digest
Software, AI, and startup news worth your time

Brief: Nvidia's market value reaches $3.01 trillion, surpassing Apple, driven by dominance in the AI sector with the H100 chip and reports of staggering profits.

Brief: Musk faces allegations of diverting Tesla's high-end H100 GPU clusters to his social media company X instead of utilizing them for Tesla's AI development, while the automaker navigates challenges with its FSD technology rollout.

Brief: Apple decides to rebrand its artificial intelligence division as 'Apple Intelligence,' embracing a simpler and more straightforward name for its AI initiatives.

Brief: Microsoft introduces Recall, an AI feature capturing PC activities, with privacy concerns as experts warn of cybersecurity risks like data storage flaws and potential exploitation by threat actors.

Brief: An ultra-thin battery, just 0.2mm thick, capable of being powered by tears offers a breakthrough in wearable technology, inspired by a "Mission Impossible" scene.

Brief: This is a free text-to-audio model that generates sound effects and production elements. Unlike its commercial counterpart, Stable Audio, this open-source model focuses on shorter audio samples and is ideal for drum beats, instrument riffs, and ambient sounds.

The Quick Byte
One coding tip because you’re technical after all

This week’s coding challenge:

Coding Challenge #64 - Spotify Playlist Backup Service

Build a service to backup and (optionally) restore Spotify playlists.

This week’s tip:

Zustand is a small, fast, scalable state management library for React applications. It provides a simple API for creating and managing a global state.

Wen?

  • Simple State Management: Ideal for small to medium-sized applications where Redux might be overkill.

  • Local and Global State: Suitable for managing both local and global state without boilerplate code.

Why?

  • Simplicity: Minimal boilerplate and easy to set up and use.

  • Performance: Optimized for performance with minimal re-renders.

  • Flexibility: Works well with React's concurrent features and can manage both local and global state.

Burp-A-Laugh
The most important meal of your day

That’s it for today! ☀️

Enjoyed this issue? Send it to your friends here to sign up, or share it on Twitter!

If you want to submit a section to the newsletter or tell us what you think about today’s issue, reply to this email or DM me on Twitter! 🐦

Thanks for spending part of your Monday morning with Hungry Minds.
See you in a week — Alex.

Icons by Icons8.

*I may earn a commission if you get a subscription through the links marked with “aff.” (at no extra cost to you).