Hermes Wiki

Concurrency Threading

Handling multiple in-flight operations within one process: async/await, event loops, locks, and pooled execution.

Why we need this / what value this brings

Blocking the event loop (in an async framework like FastAPI) silently kills throughput even though each request 'works' in isolation.

When to use this

Any time a request handler does I/O (DB call, external API call, file access).

How to use or implement this

Use async/await consistently through the call chain; never call a blocking (sync) library function directly inside an async handler.

Subtopics

Research questions

  • FastAPI's async model — where in the Localz backend is a blocking call accidentally stalling the event loop?

Empty folder — drop notes, links, and findings here as you research.

Hermes Wiki