Skip to content

Demonstrates memory efficiency of generators vs arrays when processing large files

Notifications You must be signed in to change notification settings

ThomasCarca/generator-example-typescript

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Generator Memory Example

Demonstrates how generators reduce memory usage when processing large files.

Usage

npm install
npm run generate        # Generate test data (default: 100k rows)
npm run generate 500000 # Generate 500k rows
npm run compare         # Run both approaches

Results

With 100k rows (~2.5 MB CSV):

  • Array: Loads entire file into memory (~15-20 MB heap)
  • Generator: Streams row by row (~3-5 MB heap)

The difference grows linearly with file size.

About

Demonstrates memory efficiency of generators vs arrays when processing large files

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors