Skip to content

Fastapi conversion#2071

Draft
bfoley12 wants to merge 132 commits into
devfrom
fastapi-conversion
Draft

Fastapi conversion#2071
bfoley12 wants to merge 132 commits into
devfrom
fastapi-conversion

Conversation

@bfoley12

@bfoley12 bfoley12 commented Jun 16, 2026

Copy link
Copy Markdown
Collaborator

Summary

Start of major rewrite of the API server to FastAPI and other modern frameworks (pydantic, Beanie, etc.)

This PR is the essential groundwork of the rewrite. However, further PRs are necessary for full functionality.

Major TODOs after this PR

  • Downloads
    • This involves infra design to push data from Contributions and Components into S3 as parquet (maybe delta tables if it goes that far)
  • Unit normalization (Pint/Unyt)
    • Also entails making input data formatted strings, then internally parsing the formats into better representations (objects) before storage
  • Greatly expand telemetry
  • Ensure components are only deleted when no other contributions reference it

Minor TODOs after this PR:

  • Add indices to Beanie models
  • Remove notebooks
  • Remove CIF
  • Email notifications

bfoley12 added 30 commits May 28, 2026 11:13
@bfoley12
Initial ruff formatting and uv project init
dbe2d84
@bfoley12
Added .venv and .env to gitignore
935f297
@bfoley12
Moved dev optional-dependencies to a dependency group
c395026
@bfoley12
Synced lock file
7789252
@bfoley12
Example env vars
151064e
@bfoley12
Moved to a src/proj style repo. Began creating fastapi server
6c64af2
@bfoley12
Removed project-level uv ennvironment
f4a684f
@bfoley12
Updated python version to 3.14
3d36ac7
@bfoley12
Added projects router and reintroduced prefix
7cd256b
@bfoley12
Added Beanie init
4ee507b
@bfoley12
Broke redis and kong settings into their own classes for modularity
15b5ff1
@bfoley12
Added shared types
a7b3221
@bfoley12
Removed unnecessary files
6074bf1
@bfoley12
Added packages to uv
5b24b6e
@bfoley12
Built out project domain for getting data
a1a6164
@bfoley12
Added shared dependencies for injection
5736804
@bfoley12
Added AuthenticationError and GatewayError for more control over thro…
53d4764 
…wn errors
@bfoley12
Ruff formatting and checking
afa56d9
@bfoley12
PrefixedEmail now throws ValidationError instead of ValueError
3fd595c
@bfoley12
Changed ProjectResource for ProjectOut for consistency with ProjectIn…
5ee4db3 
…. Added create_project
@bfoley12
Changed create_project to insert_project
fda647e
@bfoley12
Added Project patch for partial udpates
d71bf0c
@bfoley12
Added Project delete
3d90e3a
@bfoley12
Added Projet Upsert (put)
84de0cb
@bfoley12
Added docstrings and removed dead code
04db715
@bfoley12
Removed outdated runtime_checkable and awaited async function to get …
6e7fdda 
…returned value
@bfoley12
Created a parent class to abstract the handling of fields requested f…
5e6a4a1 
…rom query. Users can now request partial documents with _fields
@bfoley12
modified docstrings to match function definition
81b7256
@bfoley12
Fixed issue where find_one syntax was used with get
23bb878
@bfoley12
Removed dead ProjectSummary usages
b7b39f1
bfoley12 added 27 commits June 11, 2026 11:30
@bfoley12
Changed exception handling and modified variable names to be descript…
5ead312 
…ive rather than one letter
@bfoley12
Removed old settings reference and scoped contribution access to proj…
ddd0f7c 
…ect user.groups
@bfoley12
DeleteResponse now consumes a DeleteResult to allow for easier expans…
d3df2ab 
…ion later. MongoDbRepo now allows deleting multiple ids at once
@bfoley12
Removed vestigial GatewayError references
4a3224d
@bfoley12
Contribution.data validation for depth <= 7
a506df8
@bfoley12
Disallow lists in Contribution.data
f5a1323
@bfoley12
Added more validation to Contribution.data dict
62b5d29
@bfoley12
Removed useless thin wrapper method
ce318e5
@bfoley12
Inserting many components now validates by md5 hash and returns docum…
ef72571 
…ents with their id
@bfoley12
Component.insert_component delegates to insert_components
59b8a1a
@bfoley12
Attachments document model now verifies extension of file. Modified i…
ea3929b 
…mports.
@bfoley12
Greatly expanded unit testing
7b3c64b
@bfoley12
Fixed domain routers not prefixing '/'
7c10983
@bfoley12
Added more thorough integration test coverage
bb8a8aa
@bfoley12
Moved download logic to base shared repository
b13b817
@bfoley12
Added csv serialization for downloads
a060561
@bfoley12
Added tests to cover downloads
34c70bf
@bfoley12
Fixed gzip missing final packet; improved CSV serialization; improved…
88d878a 
… download filenames
@bfoley12
Moved DataFormat decision to a match statement
506d8d3
@bfoley12
Removed module-level docstrings
5f7402b
@bfoley12
Setup app to use aioboto3 and load defaults from env
8df56c5
@bfoley12
Added dependencies for boto and S3
3257589
@bfoley12
Changed filename to authz to clarify that it is authorization
eb1699a
@bfoley12
Added S3Dep and s3 reliance to download methods; modified auth import…
77298ab 
… to authz
@bfoley12
Updated auth import to authz
a466c81
@bfoley12
Uncommented kong in settings
95f6b3d
@bfoley12
Modified S3Dep to return the client rather than a generator; moved ke…
83fd840 
…y_name and bucket_name out of router function defs since they are in flux
@bfoley12 bfoley12 self-assigned this Jun 16, 2026
@bfoley12 bfoley12 added this to the API Server Rewrite milestone Jun 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@bfoley12 bfoley12

Labels

None yet

Projects

None yet

Milestone

API Server Rewrite

Development

Successfully merging this pull request may close these issues.

1 participant

@bfoley12