Max Grover
    • Create new note
    • Create a note from template
      • Sharing URL Link copied
      • /edit
      • View mode
        • Edit mode
        • View mode
        • Book mode
        • Slide mode
        Edit mode View mode Book mode Slide mode
      • Customize slides
      • Note Permission
      • Read
        • Only me
        • Signed-in users
        • Everyone
        Only me Signed-in users Everyone
      • Write
        • Only me
        • Signed-in users
        • Everyone
        Only me Signed-in users Everyone
      • Engagement control Commenting, Suggest edit, Emoji Reply
      • Invitee
    • Publish Note

      Share your work with the world Congratulations! 🎉 Your note is out in the world Publish Note

      Your note will be visible on your profile and discoverable by anyone.
      Your note is now live.
      This note is visible on your profile and discoverable online.
      Everyone on the web can find and read all notes of this public team.
      See published notes
      Unpublish note
      Please check the box to agree to the Community Guidelines.
      View profile
    • Commenting
      Permission
      Disabled Forbidden Owners Signed-in users Everyone
    • Enable
    • Permission
      • Forbidden
      • Owners
      • Signed-in users
      • Everyone
    • Suggest edit
      Permission
      Disabled Forbidden Owners Signed-in users Everyone
    • Enable
    • Permission
      • Forbidden
      • Owners
      • Signed-in users
    • Emoji Reply
    • Enable
    • Versions and GitHub Sync
    • Note settings
    • Engagement control
    • Transfer ownership
    • Delete this note
    • Save as template
    • Insert from template
    • Import from
      • Dropbox
      • Google Drive
      • Gist
      • Clipboard
    • Export to
      • Dropbox
      • Google Drive
      • Gist
    • Download
      • Markdown
      • HTML
      • Raw HTML
Menu Note settings Sharing URL Create Help
Create Create new note Create a note from template
Menu
Options
Versions and GitHub Sync Engagement control Transfer ownership Delete this note
Import from
Dropbox Google Drive Gist Clipboard
Export to
Dropbox Google Drive Gist
Download
Markdown HTML Raw HTML
Back
Sharing URL Link copied
/edit
View mode
  • Edit mode
  • View mode
  • Book mode
  • Slide mode
Edit mode View mode Book mode Slide mode
Customize slides
Note Permission
Read
Only me
  • Only me
  • Signed-in users
  • Everyone
Only me Signed-in users Everyone
Write
Only me
  • Only me
  • Signed-in users
  • Everyone
Only me Signed-in users Everyone
Engagement control Commenting, Suggest edit, Emoji Reply
Invitee
Publish Note

Share your work with the world Congratulations! 🎉 Your note is out in the world Publish Note

Your note will be visible on your profile and discoverable by anyone.
Your note is now live.
This note is visible on your profile and discoverable online.
Everyone on the web can find and read all notes of this public team.
See published notes
Unpublish note
Please check the box to agree to the Community Guidelines.
View profile
Engagement control
Commenting
Permission
Disabled Forbidden Owners Signed-in users Everyone
Enable
Permission
  • Forbidden
  • Owners
  • Signed-in users
  • Everyone
Suggest edit
Permission
Disabled Forbidden Owners Signed-in users Everyone
Enable
Permission
  • Forbidden
  • Owners
  • Signed-in users
Emoji Reply
Enable
Import from Dropbox Google Drive Gist Clipboard
   owned this note    owned this note      
Published Linked with GitHub
Subscribed
  • Any changes
    Be notified of any changes
  • Mention me
    Be notified of mention me
  • Unsubscribe
Subscribe
# Py-ART Dev Call ([#1045](https://github.com/ARM-DOE/pyart/discussions/1045)) ###### tags: `pyart`, `open-source` ## February 14, 2023 :::info - **Time:** 9:00 AM CST - **Participants:** - Max Grover - Zach Sherman - Joe O'Brien ::: ### :satellite_antenna: State of PyART * Xradar/Py-ART ENG submitted + reviewed ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * [Move to Setup.cfg](https://github.com/ARM-DOE/pyart/issues/1366) * [Move to Ruff for linting](https://github.com/ARM-DOE/pyart/issues/1387) * [Bring xdrlib module into Py-ART](https://github.com/ARM-DOE/pyart/issues/1344) * [Improving References](https://github.com/ARM-DOE/pyart/issues/1042) #### General Discussion * Xradar updates * Open Radar Shortcourse * Use data from UAH/NWS near Huntsville for the content * Try to have materials together by June ### Action Items * Send out email for headshots for AMS Short course * Tackling 1366/1387 (Setup.cfg + Ruff) - Max * Utils references identified - Zach * Joe also helping here - taking a look at referencing * Max create discussion on the openradar forum about setting up a community call ## January 31, 2023 :::info - **Time:** 9:00 AM CST - **Participants:** - Max Grover - Zach Sherman - Joe O'Brien ::: ### :satellite_antenna: State of PyART * Wheels have been fixed, released new version on conda-forge * No direct cython requirement * VPT time axis issue solved * Thanks to Zach! * Drafting up the ENG for Xradar/Py-ART ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * Xradar + Py-ART Integration * Make sure docs for each of the readers mention xradar #### General Discussion * Py-ART Xradar ENG * Drafting this week, will send to y'all * Meeting will be Monday at 11 AM Central * Xradar update * Working on new example https://github.com/openradar/xradar/issues/64 * Sent in the short course proposal ### Action Items * Add explicit steps to add docs related to xradar in Py-ART * Finish drafting + send out ENG for Py-ART + Xradar ## December 20, 2022 :::info - **Time:** 9:00 AM CST - **Participants:** - Max Grover - Zach Sherman - Joe O'Brien - Scott Collis ::: ### :satellite_antenna: State of PyART * End of year! * Analytics overview * Still ~1100 users viewing our docs per month * More papers coming in... should engage people who cite - some sort of poll? ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * Update on NumPy issues #### General Discussion * AMS postcard ### Action Items * ## December 6, 2022 :::info - **Time:** 9:00 AM CST - **Participants:** - Max Grover - Zach Sherman - Bobby Jackson - Joe O'Brien ::: ### :satellite_antenna: State of PyART * Added a new blog post working with NEXRAD + SPC report data * https://arm-doe.github.io/pyart/blog_posts/2022/hail-analysis-spc.html * Fixed a few bugs related to documentation, readers * Fixed unused variable in dealiasing * Successful closember 30 closed issues, 14 merged PRs, by 9 people ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * Wrong gate size with IRIS/Sigmet files ([#1328](https://github.com/ARM-DOE/pyart/issues/1328)) * Waiting for good-to-go on [#1329](https://github.com/ARM-DOE/pyart/pull/1329) * VPT time axis plotting issue ([#1083](https://github.com/ARM-DOE/pyart/issues/1083)) * Pre-commit hooks + code styling ([#1341](https://github.com/ARM-DOE/pyart/pull/1341)) #### General Discussion * New dealiasing paper * https://github.com/mit-ll/unet-vda * New cookbook idea - terrain with RHI * Xradar * Added georeference accessor (`radar.xradar.georeference()`) * Updated examples to conform to metadata structure * Radar Cookbook * Road to 2.0 * CyLP * NEXRAD Reader unzip replacement ### Action Items * TODO by next meeting * Put together comparison of NEXRAD Level 3 velocity + VAD retrieval, along with nearby sounding * Zach + Bobby looking at this * Could add unit test for sounding --> radar --> vad * Signup to help with the AMS Radar Shortcourse * https://openradar.discourse.group/t/ams-40th-radar-conference-open-radar-short-course/105/7 ## November 22, 2022 :::info - **Time:** 9:00 AM CST - **Participants:** - Max Grover - Zach Sherman - Joe O'Brien ::: ### :satellite_antenna: State of PyART * Released version 1.14.1 last week * Enhancements made - ENH: Add gatefilter to attenuation module #1324 (@mgrover1) - ENH: Adding fields parameter to specify list of writing to file. #1319 (@zssherman) - ENH: Improved convective stratiform functions #1314 (@lauratomkins) * Other merged PRs - ADD: Adding add_filter function to radar.py. #1326 (@zssherman) - Add Spectral-like colormaps based on pyart#1320 #1325 (@jthielen) - Add ci for Python 3.11 #1303 (@mgrover1) - ADD: Colorbar Manipulation Example #1300 (@jrobrien91) ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * Issue with sigmet gate size [(#1328)](https://github.com/ARM-DOE/pyart/issues/1328) * 2/3 of way through [Closember (#1310)](https://github.com/ARM-DOE/pyart/issues/1310) * Remaining issues * NEXRAD + SPC report blog post (Max working on this today) * VPT plotting issue (Zach looking into this) #### General Discussion * Xradar update * Cookbook update * Py-ART 2.0 checkin ### Action Items * TODO by next meeting - go through reference issue [#1042](https://github.com/ARM-DOE/pyart/issues/1042) and populate checklist of modules/submodules to add references to * Follow up on the NEXRAD data issue ## November 8, 2022 :::info - **Time:** 9:00 AM CST - **Participants:** - Max Grover - Zach Sherman - Bobby Jackson ::: ### :satellite_antenna: State of PyART * Participating in Closember! * Associated issue [#1310](https://github.com/ARM-DOE/pyart/issues/1310) * [Closed issues over the past week](https://github.com/ARM-DOE/pyart/pulse#closed-issues) * New hydromet classification + vad examples [#1317](https://github.com/ARM-DOE/pyart/pull/1317) * Grid lines has its own argument [#1311](https://github.com/ARM-DOE/pyart/pull/1311) * Deprecation warnings in phase processing solved [#1313](https://github.com/ARM-DOE/pyart/pull/1313) * Doc improvement for image muting [#1304](https://github.com/ARM-DOE/pyart/pull/1304) * Antivirus running on package [#1307](https://github.com/ARM-DOE/pyart/pull/1307) ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * PR - Convective stratiform functions [#1314](https://github.com/ARM-DOE/pyart/pull/1314) * More feedback need here, move the plotting function into graph module * Bobby + Max can take a look * **don't include in the 1.13.4 release** * PR - Colorbar manipulation [#1300](https://github.com/ARM-DOE/pyart/pull/1300) * Wait until next week * PR - QVP meteoswiss [#1046](https://github.com/ARM-DOE/pyart/pull/1046) * No updates here * PR - CI for 3.11 [#1303](https://github.com/ARM-DOE/pyart/pull/1303) * Still waiting... * Issue - DOC: Put together a blog post pairing SPC reports w/ NEXRAD data [#1157](https://github.com/ARM-DOE/pyart/issues/1157) * Ping Russ S., if not, Max can take on * Issue - [BUG: Running into issues with RadarDisplay.plot_vpt time axis #1083](https://github.com/ARM-DOE/pyart/issues/1083) * Zach taking a look * Issue - [Writing specific fields #850](https://github.com/ARM-DOE/pyart/issues/850) * Zach looking into this #### General Discussion * Closember * Xradar * Reading in whichever fields are in the file * https://github.com/openradar/xradar/issues/42 * LP processing * Looked at notebook analyzing data from SAIL * Open Radar Forum * Priorities for AGU + AMS * Examples, docs, etc. * Retrievals module in radar cookbook * SAIL retrievals example (hydro classification), qpe, etc. * Prep for Short course * Citations ### Action Items * ## October 11, 2022 :::info - **Time:** 3:00 PM CST - **Participants:** - Max Grover - Zach Sherman - Bobby Jackson - Scott Collis ::: ### :satellite_antenna: State of PyART * Added/fixed some docs the last couple of weeks * Colormap example * Region-based dealiasing * Installation * Fixed a missing cython required piece of the conda-forge recipe ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * How to modify the colorbar [#1283](https://github.com/ARM-DOE/pyart/issues/1283) * Joe! * New example showing hydrometeor classification and QPE [#1260](https://github.com/ARM-DOE/pyart/issues/1260) * Daniel W * Replace CyLP [#1022](https://github.com/ARM-DOE/pyart/issues/1022) * Bobby digging into this * Support xarray [#670](https://github.com/ARM-DOE/pyart/issues/670) * Xradar update * #### General Discussion * How high of a priority should replacing CyLP be? * What should the Py-ART accessor look like? * Same methods as a radar object? * TODO - have some cfradial sample data * Road to 2.0 * Make sure ARM is in the loop on this * Mark in a report - progress in an ENG * Rest of non-xradar should be covered in ENGs * TRMM RSL not as much of priority * Xradar * IO - readers (80%) * Write to cfradial * .to_netcdf() * Engineered the data model * Accessors - Py-ART accessors * Writing a design for this, good communication to translators * Communicate this others * Visualization * PPI example * Georeference with lats/lons ```python import xradar import pyart tree = xradar.read_cradial() tree.pyart() ``` * Possible tags * Research * Data * Meetings * Conferences + Workshops * ARM blog - things within Open Radar Science * After ARM/ASR, before AGU * What would a blog post about TRACER look like? * Bobby could write post about this - use a good case from the catalog * Py-ART and satellite data? * Should have a developers course at some point ### Action Items * Put together blog post on TRACER * Bobby + Eric + team :) * Add a colorbar modification example * Joe * Add new tags to openradar * Max * Get test cfradial2 data * Max * Moving people to openradar discussion ## September 27, 2022 :::info - **Time:** 9:00 AM CST - **Participants:** - Max Grover - Zach Sherman - Kai Mühlbauer - Joe O'Brien ::: ### :satellite_antenna: State of PyART * Release version 1.13.0 last week, high-level updates * Now have conda/pypi wheels for Apple silicon chips (as well as all the other platforms) * Composite reflectivity functionality * Bug fixes for vertical column extraction * Added another release to deal with bug fixes related to matplotlib 3.6 * Colorbar registry * Cartopy related issues - in order to use latest version of matplotlib (3.6), need latest version of cartopy (0.21) * Stopped packaging with TRMM_RSL in conda-forge * Over the past month, we have closed (great work team!) * 9 pull requests * 12 issues ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * High priority * https://github.com/ARM-DOE/pyart/issues/1042 * Especially the qvp * TODO - put together checklist of which have references * https://github.com/ARM-DOE/pyart/issues/992 * Check with VAD calc * https://github.com/ARM-DOE/pyart/issues/670 (xradar) * https://github.com/ARM-DOE/pyart/issues/1260 * Medium priority * https://github.com/ARM-DOE/pyart/issues/1274 * https://github.com/ARM-DOE/pyart/issues/1262 #### General Discussion * Xradar discussion * Biggest priorities - more readers, georeference, code coverage, schema validation * openradar discussions * https://github.com/openradar/openradar.github.io/issues/6 * New tags for open radar discourse * Python * Workshops * Data * Open Science * TODO - add easy to comment/interact * What is our road to 2.0? * Accessor to xradar * Still keep TRMM_RSL optional * FOURDD replacement (not high priority) * Definitely include replacemnet for CyLP * Code coverage to above 90% (currently at 80%) * References (need quantification here) * Move over aux_io readers (need a list here, target) * 14 of these, ex. read_kazr, others in xradar * Xradar vs. radar (how to transition to xarray) * How do we start replacing the TRMM_RSL functionality? * Can we put together a blog post schedule? * Zach also interested * Ideas * NEXRAD hurricane example (Max) * SAIL or TRACER (Joe) * QPE in switzerland (Max + Zach) ### Action Items * Sign up for [Open Radar Discourse](https://openradar.discourse.group/) * Add NEXRAD reader to xradar (Max) * Put together list of functions + references (retrieval mod) (Joe) * Populate open radar discourse tags (Max + Kai) ## September 13, 2022 :::info - **Time:** 3:00 PM CST - **Participants:** - Max Grover - Zach Sherman - Joe O'Brien - Kai Mühlbauer - Paul McCrone ::: ### :satellite_antenna: State of PyART * Taught the Open Radar Short Course - ERAD 2022 * Nice examples of QPE * Nice example of LROSE+ Py-ART * New issues * Negative heights on RHI (near mountains) * Moving IO to xradar ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * Negative heights with RHI - https://github.com/ARM-DOE/pyart/issues/1255 * TRMM RSL * Planning on releasing conda version without trmm_rsl installed * Xradar * https://github.com/ARM-DOE/pyart/issues/670 * https://github.com/openradar/xradar #### General Discussion * Xradar design * Modelling after CFRadial 2 * ![](https://i.imgur.com/N42LOLY.png) * Composite Reflectivity * DEM with radar * Max sending out availability poll * Due a week from now * Paul * Creating graphics for radar data, understanding wind farm impact on radar data * ROC - doing wind farm analysis * Mainly working with base moments * Plotting with other datasets would be great ## July 19, 2022 :::info - **Time:** 3:00 PM CST - **Participants:** - Max Grover - Zach Sherman - Joe O'Brien - Bobby Jackson ::: ### :satellite_antenna: State of PyART * Bug fixes * join radar * tests * cftime pinning ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * Enable dependabot * Grid - idea was to merge things together, consider separating into separate ds * Xarray dataree * xradar tag * Improving references * Meteoswiss related - QPE, rainfall rate * Start with Z (R ) relationships, Joe sent link over #### General Discussion * SciPy ideas * Packaging * Data models - awkward array? datatree * Advanced viz * Put into separate package * Holoviews + Pyvista * "Iconic image" * Trading card image * Cheatsheet * Py-ART for shortcourse - determine version * Good to talk about xradar ### Action Items * ## July 5, 2022 :::info - **Time:** 3:00 PM CST - **Participants:** - Max Grover - Zach Sherman - Joe O'Brien ::: ### :satellite_antenna: State of PyART * New release out last week * Cftime release * Numpy fixes * RHI ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * Numpy/cftime * Enable dependabot * Code coverage * Zach working on correction module * Added bias and noise recently * Retrieval after that * Max can look at tests for QPE * QVP code * Zach hunting down references here #### General Discussion * Cookbooks * Currently lacking an ARM-focused one - which one should we use? * SAIL with CMAC example? * Beam blockage? * Use some of the existing SAIL notebooks! * ERAD Tutorial * Which radar data should we use? * Stick with overview + gridding notebook * Maybe use ODIM dataset? * Xarray * Hackathon around this July 20-21, 4 hour block * Get stuff done! ### Action Items * Open an issue describing dependabot in Py-ART, checklist * By next meeting, have dependabot up and running * Add cookbook link in docs! ## June 21st, 2022 :::info - **Time:** 3:00 PM CST - **Participants:** - Max Grover - Zach Sherman - Joe O'Brien ::: ### :satellite_antenna: State of PyART * Released version 1.12.4 * Bug fixes ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * RSL in CI - https://github.com/ARM-DOE/pyart/issues/1159 * https://github.com/ARM-DOE/pyart/pull/1178 * Version listed in docs is wrong - https://github.com/ARM-DOE/pyart/issues/1155 * Blog posts * SPC post (Russ Schumacher) * SAIL or TRACER case? * Introducing the cookbook #### General Discussion * Earthcube interactions * Thoughts on where to link to this cookbook from Py-ART? * Py-ART Office hours * What do people think? What times would make sense? * Prep for ERAD * ### Action Items * Reach out to AWS team about adding the radar cookbook example to resources for AWS data * Add section to this meeting dedicated to questions * Ping google groups to steer discussion towards GitHub discussions * Put together list of blog post ideas * Strong storm near chicago at 00 Z on June 14, 2022 * Shoot for 10-20 minutes * GOAL: Put one together for friday ## June 6, 2022 :::info - **Time:** 3:00 PM CST - **Participants:** - Max Grover - Zach Sherman ::: ### :satellite_antenna: State of PyART * ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * #### General Discussion * Troubleshoot RHI Slicing issue ### Action Items * --- ## May 24, 2022 :::info - **Time:** 3:00 PM CST - **Participants:** - Max Grover - Bobby Jackson ::: ### :satellite_antenna: State of PyART * Fixed typo in the plotting modules (embelish --> embellish) * Xradar prototype now uses datatree * New York Times guy shared a cool interactive viz using Py-ART/augmented reality * [Link](https://twitter.com/NickBartzokas/status/1528807503747768320?s=20&t=9yO9tCQzQ4z_gManNU8nqQ) * Notebooks from Open Science Workshop added to Radar Cookbook ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * [Read cfradial data using xarray](https://github.com/ARM-DOE/pyart/pull/1112) * [Ring in MDV examples](https://github.com/ARM-DOE/pyart/issues/1156) * [Blog post using SPC data](https://github.com/ARM-DOE/pyart/issues/1157) * RSL continuous integration #### General Discussion * Xradar design * Data tree - how should we deal with merging times? * Selecting coordinates? * Current overview * Tree * Root - Instrument parameters, general metadata * Sweep 0 - dataset with field data (reflectivity, velocity) * Sweep 1 - dataset with field data (reflectivity, velocity) * [Demo notebook](https://github.com/mgrover1/pyart-xarray-sandbox/blob/main/notebooks/datatree-approach.ipynb) ```python xradar["0"].ds.plot() ``` * Cookbook update * [Radar Cookbook mostly there](https://projectpythiatutorials.github.io/radar-cookbook/landing-page.html#) * Now have: * Py-ART Basics * Py-ART Corrections * Py-ART Gridding * Moore, OK example * Next up? * ARM-specific examples * Radar data from SGP site accessed using ACT * Southern hemisphere Cordoba CACTI case * Blog posts * SPC/Radar maps * Snowfall retrievals * Other ideas? Let's brainstorm! Every other week for frequency? ### Action Items * ## May 10, 2022 :::info - **Time:** 3:00 PM CST - **Participants:** - Max Grover - Zach Sherman - Joe O'Brien - Bobby Jackson ::: ### :satellite_antenna: State of PyART * New Release - 1.12.2 😄 * Remotely read AWS * LDQuants code - Great work Joe! * New blog post * How to contribute, using the new landing page images as example - Great work Joe! ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs ##### Open Issues * Ensure monotonically increasing time when writing cf/Radial files [#1142](https://github.com/ARM-DOE/pyart/issues/1142) * Closed! Setting right flag on IO * Possible issue with docgen [#1155](https://github.com/ARM-DOE/pyart/issues/1155) * Ring in MDV files used in examples [#1156](https://github.com/ARM-DOE/pyart/issues/1156) * Put together a blog post pairing SPC reports w/ NEXRAD data [#1157](https://github.com/ARM-DOE/pyart/issues/1157) * Link to SPC report data https://www.spc.noaa.gov/wcm/data/2020_torn.csv * Improving test coverage * RSL installation? ##### Pull Requests * FIX: Fixes an issue with mismatch arrays. [#1151](https://github.com/ARM-DOE/pyart/pull/1151) * Use Xarray with read_cfradial [#1112](https://github.com/ARM-DOE/pyart/pull/1112) * ADD: Add cylp into doc requirements [#1091](https://github.com/ARM-DOE/pyart/pull/1091) * ADD: Addition of qvp functions from meteoswiss. [#1046](https://github.com/ARM-DOE/pyart/pull/1046) #### General Discussion * Outreach opportunity with "Do(n't) Use this Code" - August 31 * Cross-DOE Lab movement to Python * Cameron Riddell reached out to Zach/Max * How to contribute a blog post * Future meeting - prepare this (Max) * Status on cookbooks * Corrections with Py-ART content (from the workshops) * Gridding with Py-ART content (from the workshops) * Status on Xarray integration * Have basic workflow, some tests ### Action Items * Add first cut of general Py-ART presentation * Zach reach out to don't use this code folks * Max put together how to write a blog post * Zach submit PR to [radar cookbook repo](https://github.com/ProjectPythiaTutorials/radar-cookbook) with: - Corrections with Py-ART - Gridding with Py-ART ## April 26, 2022 :::info - **Time:** 3:00 PM CST - **Participants:** - Zach Sherman - Joe O'Brien - Robert Jackson ::: ### :satellite_antenna: State of PyART * added workflow to auto release to pypi, still working on fixes for trmm install. * Fix for nexrad rain rate, setting dtypes were wrong. * Utility to subset a radar volume for the column above a location added. * fspec added to read local and remote files. * Verbose flag added to qvp code ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * Blog post on contributing to PR and new Homeyer Images [(#1145)] https://github.com/ARM-DOE/pyart/pull/1145 * Use xarray for reading cfradial files [(#1112)] https://github.com/ARM-DOE/pyart/pull/1112 * Addition of qvp functions [(#1046)] https://github.com/ARM-DOE/pyart/pull/1046 * sorting data monotonically increasing [(#1142)] https://github.com/ARM-DOE/pyart/issues/1142 * Does Xarray do compression grid files https://groups.google.com/g/pyart-users/c/1MxTomOwFlU #### General Discussion * Working on improving the code coverage. * Validating QPE methods and references. * We can use Joe's column above a location code to take a look at the qpe methods using data from houston etc. * Joe and Matt are looking at SAIL files, chill radar files, will eventually being doing a PR for this work. ## April 12, 2022 :::info - **Time:** 3:00 PM CST - **Participants:** - Max Grover - Zach Sherman - Joe O'Brien - Scott Collis ::: ### :satellite_antenna: State of PyART * Version 1.12.1 is available on PyPi and conda-forge * Cython files now built upon installation/build * Able to remove the compiled C files from being tracked on GH * New blog post on NEXRAD data * https://arm-doe.github.io/pyart/blog_posts/2022/plot-nexrad-level3.html ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * Add cylp into doc requirements [(#1091)](https://github.com/ARM-DOE/pyart/pull/1091) * Running into `malloc` error, at the numpy C API level in CyLP ```python python(43345,0x117afc600) malloc: *** error for object 0x7f7fad9c6660: pointer being freed was not allocated python(43345,0x117afc600) malloc: *** set a breakpoint in malloc_error_break to debug ``` * Pinged cylp maintainer, have not heard anything * Looked into Google-Open Research tool alternative * Add some support for X-Array in a staged manner [(#670)](https://github.com/ARM-DOE/pyart/issues/670) * Testing things out in * Add additional default argument to pcolormesh with alpha values [(#1102)](https://github.com/ARM-DOE/pyart/issues/1102) * See the [blog post](https://arm-doe.github.io/pyart/blog_posts/2022/plot-nexrad-level3.html) * Changing the image on our landing page * Joe - working on this * Max working with Joe to get this written up as a post #### General Discussion * Radar Cookbooks * [Rendered Version](https://projectpythiatutorials.github.io/radar-cookbook/landing-page.html) * Other "foundations" * PyART * "pyart-dealiasing" * XSAPR * **Corrections with PyART** * General radar * Radar data coordinate system * Radar basics? * Other open-radar community - ping these people * wradlid-basics * plotting with wradlib? * wradlib-corrections? * Lower priority * XSACR - show some of the limtiations of grid * Much lower ROI * People get stuck with choosing min_roi * Maybe DOW data? * Xradar design * Do we want a single dictionary? Or multiple levels? * Ex. xradar --> sweep 0 --> ['ref', 'vel', ...] * OR do we need to allow for another level? * xradar --> sweep 0 --> ref () * What should the dimensions of our xarray dataset be? * (azimuth, range)? * (gate?) * For each sweep, have its own dataset * Joe working on the ldquants PR * Initial code for PR this week * Black code formatting ### Action Items * ## March 29, 2022 :::info - **Time:** 3:00 PM CST - **Participants:** - Max Grover - Zach Sherman - Joe O'Brien - Scott Collis - Bobby Jackson - Martin Rugna ::: ### :satellite_antenna: State of PyART * Gatemapper functionality * With new example - https://arm-doe.github.io/pyart/examples/mapping/plot_compare_two_radars_gatemapper.html#sphx-glr-examples-mapping-plot-compare-two-radars-gatemapper-py * First blog post looking at interactive KAZR * Now running the updated google analytics ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs ##### Issues * [ENH: Switch from disutils to setuptools #823](https://github.com/ARM-DOE/pyart/issues/823) * Able to generate C-files in the setup * `.pyxd` files are a bit of pain - not found imports * Setup is working up to ^ point * Checks for rsl library - want that in there * [BUG: Error when using CyLP](https://github.com/ARM-DOE/pyart/issues/1022) * Google option * Don't sink too much into this - waiting for cython fixes * Setting a lower bound constraints * Priority - after xradar stuff, look into google tools * [ENH: Modify the sythetic RHI code to better deal with SAILS #1086](https://github.com/ARM-DOE/pyart/issues/1086) * Joe looking into this - working on LDQuants stuff anyway * Challenges * The way it's sorted * Solutions * Getting rid of sweeps * Reorder - using the sweeps * `pyart.get_sweep? remove_sweep?` * [ENH: Include routine for MWACR vertical pointing radar #1082](https://github.com/ARM-DOE/pyart/issues/1082) * Should be straight forward - no uniform variable names * Quick metadata swap compared to KAZR * "xradar-only" ingest? * [BUG: Running into issues with RadarDisplay.plot_vpt time axis #1083](https://github.com/ARM-DOE/pyart/issues/1083) * Max can tackle this one ##### PRs * [Add cylp into doc requirements #1091](https://github.com/ARM-DOE/pyart/pull/1091) #### General Discussion * Gatemapper examples * Add example showing comparison to vertically pointing radar. See if we can use join_radar and have multiple volume comparison. * RHI example * From x-band in colorado? * Vertically pointing KAZR? * [Xradar discussion](https://docs.google.com/presentation/d/1xiyvCK6vUcY92R3TCl8REmUT4ejuIzI5QxB9YIAQ1jA/edit?usp=sharing) * [Exploration repo](https://github.com/mgrover1/pyart-xarray-sandbox) * Thoughts? * Setuptools discussion * Thoughts? * Just trying to get past current wall * Helps with dependencies/so on * Release schedule? Project Board? * Depends on the severity of things breaking * Road to 2.0 * Xradar would be a great point- get the data model, making sure all the different methods work * Would it be helpful to have an open-radar discussion soon? Around cookbooks? Xarray? * PyART * Wradlib * LROSE * Good to have a discussion about this * Gitter? * How does SMN use pyart? * Mainly as IO, help to standardize this * Plot PPIs/grid to mosaic * Creating QVP to calibrate ZDR * Interface with the different radar formats into a single object * Do this operationally * Memory management, etc. * Example of operational plots - https://www.smn.gob.ar/radar * ### Action Items * Zach looking into setuptools - debugging last few errors * Max pusing forward on cookbooks/xradar * Joe looking into RHI improvements - late next week ## March 15, 2022 :::info - **Time:** 3:00 PM CST - **Participants:** - Max Grover - Zach Sherman - Steve Nesbitt - Alfonso Ladino - Joe O'Brien - Kai Mühlbauer ::: ### :satellite_antenna: State of PyART * Github actions has been implemented for docs + tests * Codecov running * New look to docs * Cutting new release today ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * [Issue #1052 New Landing Page Images](https://github.com/ARM-DOE/pyart/issues/1052) * [Issue #943 Grid unicode error](https://github.com/ARM-DOE/pyart/issues/943) * Specific files with netcdf, ASCII files * [Issue #1042 - References in Docs](https://github.com/ARM-DOE/pyart/issues/1042) * [Issue #1022 - Cylp build](https://github.com/ARM-DOE/pyart/issues/1022) * Wait to see if magically resolves * SciPy has an option? * Steps forward * Look into scipy tools * Max can look into this * [Issue #823 - Move to setuptools](https://github.com/ARM-DOE/pyart/issues/823) * Issues - building cython files #### General Discussion * Ready for release this week? * Last one was in September, good to get this out * Increasing test coverage * [Issue #1073](https://github.com/ARM-DOE/pyart/issues/1073) * Good to include walkthrough of tests * Run examples to test them * Wradlib does this * Run notebooks through the code coverage * Matplotlib image tests * Radar cookbooks * https://projectpythia.org * https://foundations.projectpythia.org/landing-page.html * [Existing resources](https://github.com/ARM-DOE/pyart/discussions/1065#discussioncomment-2334571) * [Proposed outline of first cookbook](https://docs.google.com/presentation/d/1CBa9K6ozvJyQuCZMSRYHa_hvp1EJqpYBIiaFPCdn58w/edit?usp=sharing) * Good to have other datasets/packages * Plug in with wradlib * LROSE content * Xradar Design discussion * Link to presentation * https://docs.google.com/presentation/d/1xiyvCK6vUcY92R3TCl8REmUT4ejuIzI5QxB9YIAQ1jA/edit?usp=sharing * https://github.com/ARM-DOE/pyart/discussions/1047 * Xarray backends * Moved to xarray dataset for a single sweep * Root object to handle the data, instrument, etc. * Radar-io project? * Cross-collaboration * Non-project specific * Data formats * Steve and Alfonso looking at Zarr formatted radar data in radial format * Need to decode everything with radar data, xarray has some nice tools here... * Bring this up at discussions! ### Action Items * Prototype scipy linear solver (@mgrover1) * Prototype setuptools approach (@zssherman) * Writing tests * Joe and Max working together on blog post about writing tests --- ## March 01, 2022 :::info - **Time:** 3:00 PM CST - **Participants:** - Max Grover - Zach Sherman - Scott Collis - Bobby Jackson - Joe O'Brien ::: ### :satellite_antenna: State of PyART * Implemented Github Actions for **some** of the docs build * Google Analytics Works ### :loudspeaker: Discussion, questions, and updates * Thoughts on setting up a recurring PyART meeting? Can invite the community to join too! * Every other week? * If we don't have anything to discuss, we can always cancel! * Social Media - Does anoyone else want to help? * Setting up this as a Team account - link to pyart gmail account * Weekly updates - keep it more alive * PyART for different severe weather! #### Current Issues * Zach - references/documentation * Tagged Meteoswiss folks (Jordy) * Until we get book, see where formula for QPE module * **Most** functions include the associated reference in the docstring * Book will be only temporary placeholder * Testing Data ([#1041](https://github.com/ARM-DOE/pyart/issues/1041)) * Current process * Download data from https://engineering.arm.gov/~jhelmus/pyart_example_data/ * Move data to proper directories in the examples * Requires going through last few lines of [`.gitignore`](https://github.com/ARM-DOE/pyart/blob/main/.gitignore) file * What is the best way of dealing with this? * One way forward - [pyart-data](https://github.com/mgrover1/pyart-data-demo) package? Module? * Uses [Pooch](https://www.fatiando.org/pooch/latest/index.html) * Same strategy used by MetPy, Pythia, etc. * Data API ```python import pyart from pyart_data import get_test_data radar_file = get_test_data('XSW110520105408.RAW7HHF') radar = pyart.io.read(radar_file) ... ``` * Next steps * Modify example scripts to use this * Check to make sure github actions can handle 400+MB files * Build docs using this approach * Questions * Should this be its own package? * Advantages * Can be used by other repos (`ACT`, `RadTraQ`, `PyDDA`) * Could be a more generic `arm-test-data` * Easier to test on its own * Consistent with ProjectPythia (later date, if we want to contribute upstream, would be easier) * Easier to modify the endpoint (`https://engineering.arm.gov/~jhelmus/` for now) * Disadvantages * Another package users would need to know * Not directly packaged with PyART - requires additional download (how we deal with this now still) * Discussion * Does this sound doable? * Put into `pyart.testing` module * Zach checking to see process of adding new files * Process of adding new data * Overhaul CI [#1035](https://github.com/ARM-DOE/pyart/issues/1035) * Current issues with solving this * Building docs within CI - [#1041](https://github.com/ARM-DOE/pyart/issues/1041) will help with this * Questions * Should we use pre-commit hooks + Black code formatting? * Used to pre-check code before commiting to repo * For example if there are flake8 issues, will auto-fix * Pros * Do not need to worry about formatting * Includes auto-fixes - user does not need to go through and make edits manually * Single, formatting standard * Cons * Additional step on setup - `pre-commit install` * Some [weird formatting decisions with math](https://github.com/psf/black/issues/148) * Would likely make **numerous** changes to existing code, causing headaches with merging PRs/such * Should move forward! #### Additional Discussion -If we have time * Meetings - every other week * Zach + Max must attends * Make them open? For sure! * [Earthcube meeting](https://www.earthcube.org/2022-earthcube-annual-meeting) in June - abstract due next week * Zach put abstract for PyART + ACT for SciPy * Open ARM - Working with ARM data using various tools * Start working on abstract - Max * Cookbooks Design Doc - first design review (already scheduled) * Design review! * Xradar - Xarray in PyART - week after the cookbooks discussion * [Design discussion](https://docs.google.com/presentation/d/1xiyvCK6vUcY92R3TCl8REmUT4ejuIzI5QxB9YIAQ1jA/edit?usp=sharing) soon * Thoughts on Github Discussions? * Like the MetPy has them setup * Announcements (releases) * General (discussions about features) * Ideas (new feature ideas) * Q/A - most busy - understand this would replicate the email list * Good thing about GH Discussions - all in one place * Show and Tell - place for users to share their cool code * ![](https://i.imgur.com/cGNKZHD.jpg) * Open up discussions ### Action Items * **Setup teams on PyART Twitter Account** (Max + Scott) * **Put together design review for cookbooks** (Max + Zach) * **Add an issue with the associated agenda, updates, etc.** (Max) * **Open up Discussions on PyART** (Max) * **Schedule recurring meeting for the same time** --- ## Meeting Template ## March 15, 2022 :::info - **Time:** 3:00 PM CST - **Participants:** - Max Grover - Zach Sherman ::: ### :satellite_antenna: State of PyART * ### :loudspeaker: Discussion, questions, and updates #### Open Issues + PRs * #### General Discussion * ### Action Items *

Import from clipboard

Paste your markdown or webpage here...

Advanced permission required

Your current role can only read. Ask the system administrator to acquire write and comment permission.

This team is disabled

Sorry, this team is disabled. You can't edit this note.

This note is locked

Sorry, only owner can edit this note.

Reach the limit

Sorry, you've reached the max length this note can be.
Please reduce the content or divide it to more notes, thank you!

Import from Gist

Import from Snippet

or

Export to Snippet

Are you sure?

Do you really want to delete this note?
All users will lose their connection.

Create a note from template

Create a note from template

Oops...
This template has been removed or transferred.
Upgrade
All
  • All
  • Team
No template.

Create a template

Upgrade

Delete template

Do you really want to delete this template?
Turn this template into a regular note and keep its content, versions, and comments.

This page need refresh

You have an incompatible client version.
Refresh to update.
New version available!
See releases notes here
Refresh to enjoy new features.
Your user state has changed.
Refresh to load new user state.

Sign in

Forgot password

or

By clicking below, you agree to our terms of service.

Sign in via Facebook Sign in via Twitter Sign in via GitHub Sign in via Dropbox Sign in with Wallet
Wallet ( )
Connect another wallet

New to HackMD? Sign up

Help

  • English
  • 中文
  • Français
  • Deutsch
  • 日本語
  • Español
  • Català
  • Ελληνικά
  • Português
  • italiano
  • Türkçe
  • Русский
  • Nederlands
  • hrvatski jezik
  • język polski
  • Українська
  • हिन्दी
  • svenska
  • Esperanto
  • dansk

Documents

Help & Tutorial

How to use Book mode

Slide Example

API Docs

Edit in VSCode

Install browser extension

Contacts

Feedback

Discord

Send us email

Resources

Releases

Pricing

Blog

Policy

Terms

Privacy

Cheatsheet

Syntax Example Reference
# Header Header 基本排版
- Unordered List
  • Unordered List
1. Ordered List
  1. Ordered List
- [ ] Todo List
  • Todo List
> Blockquote
Blockquote
**Bold font** Bold font
*Italics font* Italics font
~~Strikethrough~~ Strikethrough
19^th^ 19th
H~2~O H2O
++Inserted text++ Inserted text
==Marked text== Marked text
[link text](https:// "title") Link
![image alt](https:// "title") Image
`Code` Code 在筆記中貼入程式碼
```javascript
var i = 0;
```
var i = 0;
:smile: :smile: Emoji list
{%youtube youtube_id %} Externals
$L^aT_eX$ LaTeX
:::info
This is a alert area.
:::

This is a alert area.

Versions and GitHub Sync
Get Full History Access

  • Edit version name
  • Delete

revision author avatar     named on  

More Less

Note content is identical to the latest version.
Compare
    Choose a version
    No search result
    Version not found
Sign in to link this note to GitHub
Learn more
This note is not linked with GitHub
 

Feedback

Submission failed, please try again

Thanks for your support.

On a scale of 0-10, how likely is it that you would recommend HackMD to your friends, family or business associates?

Please give us some advice and help us improve HackMD.

 

Thanks for your feedback

Remove version name

Do you want to remove this version name and description?

Transfer ownership

Transfer to
    Warning: is a public team. If you transfer note to this team, everyone on the web can find and read this note.

      Link with GitHub

      Please authorize HackMD on GitHub
      • Please sign in to GitHub and install the HackMD app on your GitHub repo.
      • HackMD links with GitHub through a GitHub App. You can choose which repo to install our App.
      Learn more  Sign in to GitHub

      Push the note to GitHub Push to GitHub Pull a file from GitHub

        Authorize again
       

      Choose which file to push to

      Select repo
      Refresh Authorize more repos
      Select branch
      Select file
      Select branch
      Choose version(s) to push
      • Save a new version and push
      • Choose from existing versions
      Include title and tags
      Available push count

      Pull from GitHub

       
      File from GitHub
      File from HackMD

      GitHub Link Settings

      File linked

      Linked by
      File path
      Last synced branch
      Available push count

      Danger Zone

      Unlink
      You will no longer receive notification when GitHub file changes after unlink.

      Syncing

      Push failed

      Push successfully