Open navigation menu

Go + Fiber CSV Processor

A high-throughput CSV processing service using Go, Fiber, and GORM with streaming parsing, worker pools, and progress tracking for large datasets.

  • Go
  • Fiber
  • GORM
  • PostgreSQL

Highlights

  • Streaming CSV parser with csv.Reader for constant memory regardless of file size
  • Worker pool pattern with bounded goroutines for controlled concurrency
  • SSE progress streaming for real-time upload feedback to client applications
  • GORM batch inserts with ON CONFLICT handling for idempotent data ingestion

Repository

View on GitHub ↗

Related Examples