--- name: DIALS core meeting 2021-09-23 tags: core meeting --- # DIALS core meeting 2021-09-23 [![hackmd-github-sync-badge](https://hackmd.io/3VrcuKsBQ4aL7P3pFXDsMQ/badge)](https://hackmd.io/3VrcuKsBQ4aL7P3pFXDsMQ) ## Previous Actions - [ ] "Contiguous Nexus" [`cctbx/dxtbx#356`](https://github.com/cctbx/dxtbx/pull/356) - [ ] Non-draft state is pending checks against issues @dwpaley raised, and checking for non-contiguous cases [[prev](https://dials.github.io/kb/core/20210715#contiguous-nexus-pr)] - [ ] dxtbx `src/` layout [[prev](https://dials.github.io/kb/core/20210715#src-layout-for-dxtbx)] - [ ] Nick: Ask cctbxbb if anyone has knowledge or experience of re-export of dispatchers on windows - [ ] This is a higher priority now - David feeling pain of missing - [ ] Also, seeing related errors "in the wild" e.g. [`cctbx/dxtbx#434`](https://github.com/cctbx/dxtbx/pull/434) - [ ] Removal of DataBlock [[prev](https://dials.github.io/kb/core/20210909#datablock), [prev](https://dials.github.io/kb/core/20210826#removal-of-datablock)] - [ ] **Nick:** More visible deprecationwarning - [ ] Impact assessment to see what/who is affected - [ ] Other repositories - stuff like, iota, prime, ls49, labelit, labelit-regression, xfel-regression, lunus, uc_metrics gitlab/cctbx*, phenix and phenix_regression (phenix.image_viewer) - DXTBX/pycbf [[prev](https://dials.github.io/kb/core/20210826#cbflib-conda-forge-packagepycbf)] - Outstanding: [`dxtbx#368`](https://github.com/cctbx/dxtbx/pull/368) for optional cbflib/_adaptbx . * [ ] ND: conda-forge pycbf: Make new release to use dials-data directly for tests * [ ] Last status: one `labelit`/`labelit_regression` test still doesn't pass * All except one labelit tests are now working. On NKS todo list to fix. * Progress on CBFlib 0.9.7? - [ ] Nonconventional P1 indexing [[prev](https://dials.github.io/kb/core/20210909#nonconventional-p1-indexing)] - [ ] RG to look and see how hard it is to return P1 in user-specified order ## Agenda ### Nonconventional P1 indexing - Problem with P1 indexing not being returned in user-specified setting/order - Not doing so has XFEL gui repercussions - Issue at [`dials/dials#1878`](https://github.com/dials/dials/issues/1878) - Richard has written [`dials/dials#1880`](https://github.com/dials/dials/pull/1880) - Outstanding test fail on mac/windows - possible numerical instability? ### Deterministic Experiment Identifiers - ([Previous dicussion](https://dials.github.io/kb/core/20210909#deterministic-experiment-identifiers)) - Previously: It would be useful to describe the problem that is trying to be solved - LBL had technical discussions: - cctbx.xfel.merge - modular - can specify which list of workers you want to do in a row. Use case: 380k images - each with 20k reflections - millions into memory. First thing it does is throw away image sets - uses too much memory - even when distributed - Discussion about `ImageSequence` and why we moved that - Sounds positive that this might be a good way to solve - **Action:** Aaron Change `dials.stills_process` to default to composite mode and not write experiment files - **Action:** Aaron/GW: Organise another meeting to go over ["load before heat death"](https://github.com/cctbx/dxtbx/pull/118) PR and reasons why, solutions etc - Discussed whether general metadata field would still be useful - After some spirited discussion, the conclusion was that this would be ripe for abuse - if there is a convincing case then we are happy to reconsider, but shelving for now ### Generating Collection Strategy - Art: Hit a wall with labelit, wanted to use DIALS - Have two images, each taken from 90° apart, and wanted to get an indexing solution from this - Want to use this to help users develop a collection strategy - Glued various DIALS parts together, integration had issues - reference reflections did not match indexed reflections - AB: _Strategy_ is a hole in our infrastructure - Discussion on DIALS East work on `xia2.strategy` and how we were never quite satisfied with it - Discussed `dials.export_best` and our reasoning about strategy generation from still vs small wedge data - [Nick] Probably fair to conclude - Strategy is a hole in our _publicliy advertised_ infrastructure ### Next meeting Thursday, October 7th, 4pm UK (BST), 8am PDT.