Performance Caching

Implements intelligent LRU (Least Recently Used) cache with TTL expiration that automatically caches GET requests, delivering 13.7x speedup (92% faster) on repeated requests. Inspired by Bruno API client, the cache is thread-safe, limits memory usage to 100 entries, and expires data after 5 minutes to balance performance with data freshness.

The Potential

For API Development/Testing:

• 13.7x faster for repeated queries
• Saves network bandwidth - 90% fewer network calls
• Reduces API rate limiting issues - fewer actual requests
• Better UX - Near-instant responses for cached data
• Cost savings - Fewer API calls for metered APIs

Real-world impact:

10 requests: 1425ms saved 100 requests: ~14 seconds saved 1000 requests: ~2.3 minutes saved