owned this note
owned this note
Published
Linked with GitHub
---
name: DIALS core meeting 2025-07-31
tags: core meeting
---
# DIALS core meeting 2025-07-31
## Previous Actions
- [ ] **ND** Investigate getting `psana` tests running on the DIALS xfel-regression testing
- [ ] **ND**: Move dials.diamond.ac.uk to a redirect to dials.github.io
- [ ] **ND**: Action: Replace dials-support link with slack link/new mailing list address
## Agenda
### Numpy 2 / Python 3.13
- Work done.
- Numpy 2 support in [cctbx/dxtbx#751](https://github.com/cctbx/dxtbx/commit/375e9322a1873bb7e9355960ef36da65579b82a0) [dials/dials#2942](https://github.com/dials/dials/commit/c3b7b6892497c9681dd0c45acc1c859fd2c2618a)
- Python 3.13 support in [cctbx/dxtbx#826](https://github.com/cctbx/dxtbx/commit/7ccefdc20315524fae25a0973c61e5f1ee3a6fb4) [dials/dials#2946](https://github.com/dials/dials/commit/d78db9ff3513f33ad1b56a63c4ed854006fabc78)
- Previously discussed: To test, let's add to matrix to run both and python 3.13 in branch. DP will do this.
- Discussion about https://github.com/cctbx/cctbx_project/issues/1084 and numpy 2 support
- Notes on flumpy, idea about abstracting to separate library.
Situation has got much worse, because need to wait on psana2? The build is really "tenuous" (i.e. flakey?) - entirely new format (xtc2) new library and DOES NOT play nice with MPI code - been working with a custom build which is not merged into main and not sure if numpy2 - person in charge has just gone on vacation for August. Game over. You will not go to space today.
Numpy 1 is EOL in September THIS YEAR. DIALS main should support numpy2 before this.
### DIALS Office Hours
- 3pm Thursdays was what we talked about
- ND talk to JBE about running
- Make informal promise for office hours, and a slack channel that people can make known that they have a request to chat/for help about a particular topic
- JBE booked room, not sent out invites/ zoom yet - try to get done in next week.
- [ ] Consider sending reminder to slack day before advertising
- [ ] James to follow up with advert to non-Diamond people as it is happening already at DLS
- Graeme suggested "themes" for the office hours
### Metrics
- Aaron wants to have a dials tag attached to all export, then we can make sure that is always carried through to refined structure. Aaron will handle Phenix, DW will try for CCP4.
- CCP4 GUI, data is lost when packaging mmcif
- Ongoing investigations, optimism that can be fixed
- DGW made some progress, agreement to add history recording into experiments file. Will pick up again after Easter, but WIP.
- Discussion between Aaron/DGW about contents of history/approach across cctbx/dials
- Address when david back
- 08/05/25 update - DGW - PR nearly ready that records history item in experiments file. Top level field outside of experiment list. But will require a number of dials changes as often we make new lists/copies, so will need to copy across history. dxtbx PR first, then follow up with dials once in.At point of export, look through existing history items and extract integrate, scale lines and filter those out.
- Follow up with Aaron again next time.
- PRs and Blockers:
- ~~https://github.com/dials/dials/issues/2931 - version numbering off~~
- Aaron had build issue, a joint look has identified issues, DGW can continue
- Build issues resolved
- Suggestions for changes to history generation fed back
- ASB happy with this as it stands: version ? is fine, work to do for conda build of xfel
## https://github.com/cctbx/dxtbx/pull/816
- History
- Awaiting comment from Aaron/Yang Ha
- Ready to give a try
- Awaiting looking at from Yang
- Merge, start tracing which programs preserve history to the PDB
Can play with the [power BI page](https://app.powerbi.com/view?r=eyJrIjoiZWQxYzQ3OGUtZGIwYS00NDZmLTk1YjctNDU1YmViNTI5ZDNjIiwidCI6IjM5NjU3M2NiLWYzNzgtNGI2OC05YmM4LTE1NzU1YzBjNTFmMyIsImMiOjZ9)
Similar page for deposition incoming, by year / institute etc. - working out now how to integrate with the RST for dials.github.io pages.
## DIALS Dependency unification
- https://github.com/dials/dials/pull/2732
- Do we need to keep `.conda_envs/*.txt` present (with e.g. a notice saying not to edit directly?)
- General agreement
- Aaron is always happy!
- In 2025-07-31 DIALS telco agreement is that this is ready to merge
## iota and Prime
- Both developers moved on
- Iota: trouble configuring on recent python versions
- DIALS pulls from conda-forge directly
- This would be a solution for XFEL
- Prime easier to drop but defer decision
- Aaron to ask Mona what she wants to do with Prime (still on to-do)
## AOB
### dials.search_beam_position issues
- In discussion between Aaron and Marko
- Need to understand how to import the data to correctly represent this experiment
- Half of the raised issues resolved, the other half not sure how to address
- Now working for each detector in the experiment separately
- Non-integer results should be expected
- Aaron wants a true "per image, per image" to monitor beam centre drift, with a different detector model for each image (need to make sure this is the shape on import)
- Skip spot-free images
### HDRMX
- At ACA
- Discussion about moving from forwards a bit
- This meeting happened, Aaron to collate notes
### Hamburg meeting
- Iris announced!
- DIALS meeting 16th/17th beforehand - arrive on 16th
- Graeme is chasing up
- Not sure anyone from DLS going
### SSRL / LCLS user meeting, ALS user meeting
- Want common tutorials and tutorial data
- Aaron: sbgrid, google colabs?
- Bootcamp at NE-CAT used SBgrid cloud - if paid for $200-$500 for 2 days for 20 students
- Graeme: put data to zenodo, tutorials on GitHub
### AOAOB
- ASB at DLS on September 11th, GW there also
- Hamburg: imageset, sequences, laziness so it works on 100,000 image HDF5 files
### Next meeting
Thursday, August 13th, 4pm (BST), 8am (PDT), 10am (CDT)