Changelog¶
This document records the main changes to the sdssdb
code.
0.11.2 2024-04-24
Add column
can_offset
totoo_metadata
.
0.11.1 2024-04-24
Fix typo in
CatalogToToO_Target
model name.
0.11.0 2024-04-24
Explicitly define
CatalogToXXX
models instead of loading them dynamically.
0.10.0 2024-04-23
Add
disabled
flag to tile.Add new cadences.
Add
catalogdb.too_target
andcatalogdb.too_metadata
tables and models.
0.9.0 2024-03-08
Added legacy survey sql schema files
Added new peewee and sqlalchemy ORMs for
astra
schema.Add new schema for
astra
tosdss5db
.
0.8.3 2023-12-11
Fix hardcoded schema in SQLAlchemy
opsdb.overhead
model.Add column
macro_id
toopsdb.overhead
.
0.8.2 2023-12-05
Change
DATE
toTIMESTAMPTZ
for the datetime columns inopsdb.overhead
and models. Fixed the SQLAlchemyOverhead
model which was intargetdb
by mistake.
0.8.1 2023-12-05
Updated GitHub workflows.
Added
opsdb.overhead
table and models for Peewee and SQLAlchemy.
0.8.0 2023-10-23
Added new peewee and sqlalchemy ORMs for
vizdb
schema.Added new schema for
vizdb
schema insdss5db
.
0.7.0 2023-09-28
Added
allStar-dr17-synspec_rev1
table and models.Added files to create
catalogdb.lvm_magnitude
.Added complete SQLAlchemy models for
sdss5db
.
0.6.6 2023-08-17
Added the option to disable database autoconnection by setting
sdssdb.autoconnect = False
or an environment variableSDSSDB_AUTOCONNECT=false
.
0.6.5 2023-08-09
Hotfix for a bug introduced in 0.6.4 that would prevent a connection to fail without errors when a profile was not present on import.
0.6.4 2023-08-08
Implement fine-grain field priorities
Add ‘pipelines’ profile
Updates and fixes for cadences and obsmodes
Add LVM schema and model classes
Add
catalogdb.rave_dr6_xgaiae3
(Gaia DR3 cross-match for RAVE DR6).
0.6.2 2023-02-12
Speed up loading of reflected tables by caching results except if the table is not found in the schema.
Update to allow for v1.0.6 of eROSITA superset catalogues.
Rename
SagittaEDR3
toSagitta_EDR3
.
0.6.1 2023-01-19
Update auto schemas.
Add
assignmentStatus
table to targetdb.Don’t count observed designs in
queue.rm
.
0.6.0 2022-12-29
Many additions to
sdss5db
, mainly related to target selection v1. See the commit list for details.
0.5.5 2022-09-11
[Feature] #127: Add
Design.field
attribute.Multiple additions to
catalogdb
for v1.Fix issue with
get_database_columns
.Update default Cadences to v2.
Fixes to opsdb, targetdb.
Use full hostname for sdss5-db at APO.
0.5.4 2022-07-15
New catalogs: gaia DR3
Improve offset support
Add
targetdb.design_to_field
table
0.5.3 2022-05-19
New catalogs: gaia eDR3, skies_v2, legacy_survey_dr10a
Support opsdb_apo or opsdb_lco depending on OBSERVATORY environment variable
0.5.2 2022-04-01
Add
manual
column toopsdb.design_to_status
Add more magnitudes to targetdb
Add assignment_hash to
targetdb.design
0.5.0 2021-11-16
Bug fixes found during commissioning
Add
targetdb.design_mode_value
tableAdd
targetdb.field_reservation
and associated peewee util
0.4.13 2021-11-16
Minor bug fixes
Add
mugatu_version
, andrun_on
totargetdb.design
0.4.12 2021-11-16
Several major modifications to
targetdb
andopsdb
schemas.Add
skies_v2
,bailer_jones_dr3
,sagitta_edr3
, and APOGEE DR17 tables.
0.4.11 2021-10-12
Add
lco5
profile for LCO.Add targetdb
data_table
.Do not cache database field. This was causing issues when reflection was used multiple times in the same routine.
Add cadence generator scripts, cfg files, and notebook for merging.
Fix a bug with the documentation not building with Sphinx 4.
Add cadences and engineering design modes.
0.4.10 2021-08-25
When calling
DatabaseConnection.become
, ignore the password stored in the DSN parameters since the user/admin passwords will likely be different.Add
run_on
field totargetdb.carton
.Add
default_lambda_eff
totargetdb.instrument
.Add
apql
tables toopsdb
.Add
apo5
profile.Add priority to field table to
opsdb
0.4.9 2021-04-19
DatabaseConnection.become_admin
andbecome_user
now accept a user parameter. If not provided, defaults to the old behaviour (using theadmin
anduser
fields in the profile).Add
tycid
column toTycho2
to prevent import errors.Add delta_ra, delta_dec and, inertial for
CartonToTarget
.
0.4.8 2021-03-05
Fix name collision in previous version by changing the column_name of TIC_v8 foreign key.
0.4.7 2021-03-05
[Feature] #66: Update targetdb schema with changes to cadence, carton_to_target, and others.
Change default FK in TIC_v8 for
Tycho2
.[Bug]: Use refection only if
use_reflection=True
.Modifications to
apogeedb
dump.Multiple new tables for
sdss5db.catalogdb
related to SDSS-V target selection v0.5.
0.4.6 2020-11-12
[Feature] #43: Add a database registry
Initial schema files for
opsdb
.Schema files for multiple
catalogdb
tables in preparation for SDSS-V target selection v0.5.Fix reflection for
catalogdb.skies_v1
.Added field
value
tocarton_to_target
.Initial version of the
sdss5db.opsdb
schema.
0.4.5 2020-07-12
Add single precision float type to the list of Peewee arrays during reflection.
Add
ForeignKeyField
fromCatalogToSDSS_DR13_PhotoObj_Primary
directly toSDSS_DR13_PhotoObj
.
0.4.4 2020-07-07
Add DR16 versions of APOGEE tables.
Move deprecated tables to
deprecated
schema insdss5db
.Add
catalogdb.gaia_assas_sn_cepheids
table.Add
lite
materialized views tocatalogdb
.Clear metadata on reconnect.
Ensure reflection assigns double type arrays.
Use
autorollback=True
by default inPeeweeDatabaseConnection
.Add
ForeignKeyField
toTIC_v8
where for all models incatalogdb
connected to Gaia.
0.4.3 2020-06-05
Add
position_angle
column totargetdb.field
.Add
z
column totargetdb.magnitude
.Rename
targetdb.program
tocarton
, andsurvey
tomapper
. Addpriority
field incarton_to_target
.Add schema for
gaia_dr2_ruwe
.
0.4.2 2020-05-29
Allow to use
ReflectMeta.reflect
manually even ifuse_reflection
has not been set inMeta
.Modify
targetdb
schema so thatmagnitude
referencestarget
instead of the other way around.Use schema-qualified keys for
database.models
.Add
targetdb.version.tag
column.
0.4.1 2020-05-18
Rename
targetdb.version.label
andcatalogdb.version.version
toplan
.
0.4.0 2020-05-15
[Feature]: A new
ReflectMeta
metaclass that provides reflection for Peewee models (with some caveats).[Feature]: New framework for writing tests against databases.
Use
host=localhost
when a profile is being used on its own domain.[Bug] #28: Temporarily remove SQLAlchemy implementation of
sds5db
since it’s not maintained. We may reintroduce it later once the schema is stable.Add
PeeweeDatabaseConnection.get_model
to retrieve the model for a given table.New tools for database
maintenance/internals
.New tools for table
ingestion
.Changes to the schema display tools.
Reimplementation of most catalogdb PeeWee model classes for catalogdb using reflection.
Many changes to the
catalogdb
schema files and PeeWee implementation to match the contents to SDSS-V v0 target selection.Write tests either for
peewee
orsqlalchemy
databases.Adds ability to test against real or fake databases.
Adds ability to generate fake data based on real database models for tests.
Test suite only runs where existing local databases found. Optionally run only
peewee
orsqlalchemy
tests.[Support] #32: Assume that both SQLAlchemy and Peewee will be installed and simplify code.
0.3.2 2020-03-10
New schema and models for
sdss5db.targetdb
.Change
operations-test
profile tooperations
using the new machine hostname.
0.3.1 2020-02-24
Fix import of
mangadb
schema inPlate.mangadb_plate
.[Bug] #18: Fixed Travis built after migration to using
setup.cfg
.Added
archive
database withsas
schema.
0.3.0 2019-09-23
[Feature] #15: New CLI
file2db
and associated tools to create and load a table from a file. Also added Numpy adaptors.[Feature] #14: Add support for table
DR14Q_v4_4
incatalogdb
.[Feature] #16: Changed the package internals to use
setup.cfg
.[Feature] #13: Add support for schema
apogeeqldb
inoperationsdb
.connect
now acceptsuser
,host
, andport
to override the default profile parameters.Updated schema for
mangadb.Plate
.Added
TIC v8
.Removed
TIC v6
.
0.2.2 2019-07-24
Update
PyYAML
requirement to 5.1 and use explicit loader.Improved descriptions in
setup.py
andREADME.rst
.Added
operationsdb
SQL schemas.Fixed import of database connections when Peewee or SQLAlchemy are not available.
0.2.1 2018-12-14
[Bug]: Remove
bin/sdssdb
from the list of scripts to install. This was making the build process fail.
0.2.0 2018-12-14
[Feature] #7: Added
create_schema_graph
function to generate schema graphs and use it to auto-generate graphs in the documentation for the supported databases.Improve model
__repr__
.Use
pts_key
for fk relationship betweenTwoMassClean
andTwoMassPsc
.Use
tmass_pts_key
for fk relationship betweenGaiaDR2TmassBestNeighbour
andTwoMassPsc
.Added
mangadb
schema for SQLA.Fixed command line example about how to install with
sdss_install
.Removed some unused files from the template.
0.1.1 2018-12-10
Set
python_requires='>=3.6'
.
0.1.0 2018-12-10
Basic documentation.
Implemented database connection switching in SQLAlchemy.
Support for sdss5db, operationsdb (apodb/lcodb), and manga (only in SQLAlchemy).
DatabaseConnection
class with Peewee and SQLA subclasses.Initial version.