XArray load_by_step: An accessor for loading huge files from a THREDDS server

OceanHackWeek 2024 Project done by Marcelo Andrioni and João Pedro Amorim in which the main goal was to develop a xarray function capable of loading huge amounts of data accessed through a THREDDS server.

Folder Structure

• src/load_by_step Contains the main functions necessary to use the load_by_step() accessor
• final_notebooks Contains the main notebooks with examples of using the load_by_step() accessor

Project Name

xarray load-by-step

One-line Description

A Xarray accessor to download large quantities of data from THREDDS server automatically breaking a large request in smaller requests to avoid server timeout.

How to install?

pip install load_by_step@git+https://github.com/oceanhackweek/ohw24_proj_xarray_load_by_step_us

Planning

Collaborators

Name	Location	Role
Marcelo Andrioni	Bigelow	Participant
João Pedro Amorim	Bigelow	Participant

Planning

• Initial idea: "short description"
• Ideation jam board: Add link
• Ideation Presentation: Add link
• Slack channel: ohw24_proj_name
• Project google drive: Add link
• Final presentation: Add link

Background

Goals

Datasets

Workflow/Roadmap

Results/Findings

Lessons Learned

References