Releases: PyAutoLabs/PyAutoLens
March 2023 (2023.3.27.1)
March 2023 (2023.3.21.5)
This is the latest version, which primarily brings in stability upgrades and fixes bugs.
January 2023
This is a major release, which updates many aspects of the API, switches configuration files to YAML, requirements, etc.
API Changes:
- All elliptical light profiles and mass profiles no longer prefix with the
Elltag, for conciseness / readability. For example,EllSersicis now justSersic, andEllIsothermalis nowIsothermal. - The
Sphprefix is now a suffix, for exampleSphSersicis nowSersicSphandSphIsothermalis nowIsothermal. - The ``elliptical_components
parameter has been shorted toell_comps`. - The
ExternalShearinput has been changed fromelliptical_componentstogamma_1andgamma_2(the shear is still defined the same, where in the olversion versionelliptical_components[0] = gamma_2andelliptical_components[1] = gamma_1. - The
manual_API for data structures (e.g.Array2D,Grid2D) has been removed.
Yaml Configs
- Configuration files now support
.yaml, which is provided with the autolens_workspace (https://github.com/Jammy2211/autolens_workspace/tree/release/config). - The workspace configuration files are now fully documented,.
Linear Light Profiles / Basis / Multi Gaussian Expansion
Linear light profiles are now supported, which are identical to ordinary light profiles but the intensity parameter is solved for via linear algebra. This means lower dimensionality models can be fitted, making dynesty converge more reliably:
Fits use a Basis object composed of many linear light profiles are supports, for example using a Multi Gaussian Expansion of 20+ Gaussians to fit the lens's light:
These features are described fully in the following HowToLens tutorial:
API Documentation
API documentation on readthedocs is now being written, which is still a work in progress but more useable than it was previously (https://pyautolens.readthedocs.io/en/latest/api/data.html).
SLaM V2
The Source, Light and Mass (SLaM) pipelines have been updated to a version 2, which simplifies the pipelines and makes the API more concise (https://github.com/Jammy2211/autolens_workspace/tree/release/slam).
Requirements
The requirements of many projects have been updated to their latest versions, most notably dynesty v2.0.2.
July 11 2022 Release
-
autolens_workspace now has
advancedpackages which make navigation simpler for new users to find beginner scritps. -
Redesign of position based lens mass model resampling. This feature now uses a likelihood penalty term based API, which includes a new default approach which traces (y,x) coordinates of multiple images from the image plane to the source plane and decreases the likelihood based on how far part in the source-plane they are (as opposed to resampling the mass model). See this doc for a full descritipon (https://pyautolens.readthedocs.io/en/latest/general/demagnified_solutions.html).
-
If the position-based likelihood penalty term is not included in a fit using an
Inversion(e.g. pixelized source reconstruction) an exception is raised, because the fit will likely cause a demagnified solution. This can be disabled manually (see https://pyautolens.readthedocs.io/en/latest/general/demagnified_solutions.html). -
LightProfileOperated objects implemented, which are already convolved with the imaging dataset's PSF for modeling point source components in a galaxy (see https://github.com/Jammy2211/autolens_workspace/blob/release/scripts/imaging/modeling/advanced/light_parametric_operated__mass_total__source_parametric.py).
-
Numba is now an optional installation, see this doc page for a full description (https://pyautolens.readthedocs.io/en/latest/installation/numba.html).
-
Starting point API for starting an MCMC fit with walkers in certain positions or maximum likelihood estimator fit with a start point implemented (PyAutoLabs/PyAutoFit#562). The example tutorial script for this feature is not written yet.
May 2022
Multiwavelength lens modeling:
- https://pyautolens.readthedocs.io/en/latest/overview/overview_7_multi_wavelength.html
- https://github.com/Jammy2211/autolens_workspace/tree/release/notebooks/multi
Full Likelihood description notebook:
PyAutoGalaxy full release:
March 30 2022
- Support for Python 3.9, 3.10.
- LogGaussianPrior implemented.
- Can output
Galaxy,Plane,Tracerto and from json viaoutput_to_jsonandfrom_jsonmethods.
Added a step-by-step guide to the log_likelihood_function:
March 2022
Documentation showing how to analyze the results of a lens model fit now available on workspace:
https://github.com/Jammy2211/autolens_workspace/tree/release/notebooks/results
Winter 2022 Release
The primary new functionality are new source-plane pixelization (Delaunay triangulations and a Voronoi mesh) and regularization schemes which:
- Use interpolation when pairing source-pixels to traced image-pixels.
- Use a derivate evaluation scheme to derive the regularization.
These offer a general improvement to the quality of lens modeling using inversions and they correspond to the following classes:
Other features include:
-
Directly fitting a lens model to a lens model quantity (e.g. the deflection angles, convergence) as opposed to using data (https://github.com/Jammy2211/autolens_workspace/tree/release/scripts/misc/model_quantity).
-
Cored steep elliptical (CSE) implementation of various stellar and dark matter mass profiles for deflection calculation speed up (https://arxiv.org/pdf/2106.11464.pdf).
-
Simulating lens datasets where the source signal-to-noise ratio is an input (https://github.com/Jammy2211/autolens_workspace/blob/release/notebooks/imaging/simulators/misc/manual_signal_to_noise_ratio.ipynb).
2021.10.14.21
Note on backwards compatibility
The unique identifers of certain lens model will change as a result of this release, meaning that backwards compatibility may not be possible. We have a tool which updates the identifiers to this version such that existing results can be updated and retained, please contact me on SLACK if this is necessary.
Function Renames
Many core functions have been renamed for conciseness, for example:
deflections_2d_from_grid -> deflections_2d_from
convergence_2d_from_grid -> convergence_2d_from
This should not impact general use and the workspace has been updated with new templates using these functions.
Double Source Plane Lens Inversions
Reconstruction of multiple strong lensed sources at different redshifts (e.g. double Einstein ring systems) is now supported, including full model-fitting pipelines. The API for this is a natural extension of the existing API whereby multiple sources are allocated a Pixelization and Regularization:
lens = af.Model(
al.Galaxy,
redshift=0.5,
bulge=af.Model(al.lp.EllSersic),
mass=af.Model(al.mp.EllIsothermal)
)
source_0 = af.Model(
al.Galaxy,
redshift=1.0,
mass=al.mp.SphericalIsothermal,
pixelization=al.pix.VoronoiMagnification,
regularization=al.reg.Constant,
)
source_1 = af.Model(
al.Galaxy,
redshift=2.0,
pixelization=al.pix.VoronoiMagnification,
regularization=al.reg.Constant,
)
model = af.Collection(galaxies=af.Collection(lens=lens, source_0=source_0, source_1=source_1))
The following workspace examples demonstrate double source modeling and visualization further:
https://github.com/Jammy2211/autolens_workspace/blob/release/scripts/imaging/modeling/mass_total__source_sis_parametric__source_parametric.py
https://github.com/Jammy2211/autolens_workspace/blob/release/scripts/imaging/chaining/double_einstein_ring.py
https://github.com/Jammy2211/autolens_workspace/blob/release/scripts/imaging/chaining/pipelines/double_einstein_ring.py
https://github.com/Jammy2211/autolens_workspace/blob/release/scripts/plot/plotters/InversionPlotter.py
https://github.com/Jammy2211/autolens_workspace/blob/release/scripts/plot/plotters/FitImagingPlotter.py
Signal To Noise Light Profile Simulations
A class of signal-to-noise based light profiles, accessible via the command al.lp_snr, are now available. When used to simulate strtong lens imaging, these light profiles automatically adjust their intensity parameter based on the noise properties simulation to give the desired signal to noise ratio:
bulge=al.lp_snr.EllSersic(
signal_to_noise_ratio=50.0,
centre=(0.0, 0.0),
elliptical_comps=al.convert.elliptical_comps_from(axis_ratio=0.9, angle=45.0),
effective_radius=0.6,
sersic_index=3.0,
),
When combined with a Tracer the signal to noise of the light profile's image is adjusted based on the ray-traced image, thus it fully accounts for magnification when setting the signal to noise.
A full description of this feature can be found at this link:
W-Tilde Inversion Imaging Formalism
All Imaging Inversion analysis uses a new formalism for the linear algebra, which provides numerically equivalent results to the previous formalism (which is still implemented and used in certain scenarions).
The W-tilde formalism provides a > x3 speed up on high resolution imaging datasets. For example, for HST images with a pixel scale of 0.05" and a circular mask of 3.5", this formalism speeds up the overall run-time of a fit (e.g. one evaluation of the log likelihood function) from 4.8 seconds to 1.55 seconds. For higher resolution data or bigger masks an even more significant speed up is provided.
Users so not need to do anything to activate this formalism, it is now the default method used when an inversion is performed.
Implicit Preloading
Imaging and Interferometer analysis now use implicit preloading, whereby before a model-fit the model is inspected and preloadsare automatically generated for the parts aspects of the model-fit which do not change between each lens model. Previously, these would have been recomputed for every model fit, making the log likelihood evaluation time longer than necessary.
Example quantities which are stored via implicit preloading are:
- If the light profiles of all galaxies are fixed, their corresponding blurred image-plane image is preloaded and reused for every lens model fit.
- If the mass profiles of all galaxies are fixed, the deflection angles and ray-tracing do not change. Preloading is used to avoid repeated computation.
- Numerous aspects of the linear algebra of an inversion can be preloaded depending on which parts of the model do or do not vary.
This will provide significantl speed up for certain lens model fits.
2021.8.12.1
- Fixed installation issues due to requirement clashes with scipy.
- Database and aggregator support GridSearch model-fits, primarily for dark matter subhalo scanning models.
- Aggregator supports generation of tracers and fits which are drawn randomly from the PDF, for error estimation.
- Visualization of 1D light profile, mass profile and galaxy profile quantities with errors via the aggregator.
- More visualization tools, described at https://github.com/Jammy2211/autolens_workspace/tree/release/scripts/plot