Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FALL 2024 & SPRING 2025: Project Organization #14

Open
andrewfagerheim opened this issue Sep 23, 2024 · 1 comment
Open

FALL 2024 & SPRING 2025: Project Organization #14

andrewfagerheim opened this issue Sep 23, 2024 · 1 comment
Labels
documentation Improvements or additions to documentation good first issue Good for newcomers

Comments

@andrewfagerheim
Copy link
Collaborator

This issue contains meeting notes, action items, and updates starting September 2024. For similar issues from previous semesters see:

@andrewfagerheim andrewfagerheim added documentation Improvements or additions to documentation good first issue Good for newcomers labels Sep 23, 2024
@andrewfagerheim
Copy link
Collaborator Author

andrewfagerheim commented Sep 23, 2024

23 Sept 2024: Meeting w @dhruvbalwada

Notes: parallelization

  • Use dask (that's built into xarray) to parallelize the interpolation process. If this automatic integration doesn't work, then we might need to use the dask library directly. Hopefully this is not the case, it would warrant further discussion.
  • Choose the profile dimension for chunking; this is the parallelizable dimension because our analysis treats each profile separately.
  • Ensure that multiple cores are being used by checking the argo dashboard. Start with simple test cases in the xarray documentation to make sure functionality is working as expected. Also check that the LEAP hub and gyre both give the same results to make sure results are not machine-dependent.

Notes: vertical coordinate

  • A broader note on using density as the vertical coordinate; there are two reasons to do this.
    • The first is mechanistic---to remove the influence of internal waves stretching and squeezing isopycnals but not stirring the tracers.
    • The second is analytic---to more readily visualize if bands of high variance are "sliding" along isopycnals into the interior in regions of deepwater formation, which would connect these variance results with ventilation.
  • The process for this coordinate transformation is as follows:
    • C(z,x,t), ρ(z,x,t) --> C(ρ,x,t)
    • C(ρ,x,t) --> C(zρ,x,t)
    • Then either C(zρ,x,t) is used to calculate variance
    • Or C(zρ,x,t) --> stretching of N2 is considered
    • Then this metric would be used to calculate variance

Next steps:

  • reread Ferrari 2005 and take notes here, see Dhruv's notes here
  • read SWOT proposal and take notes here
  • test dask parallelization with example from xarray documentation
  • test dask parallelization with interpolation function

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

1 participant