Changelog

This document records the main changes to the sdssdb code.

0.11.2 2024-04-24

  • Add column can_offset to too_metadata.

0.11.1 2024-04-24

  • Fix typo in CatalogToToO_Target model name.

0.11.0 2024-04-24

  • Explicitly define CatalogToXXX models instead of loading them dynamically.

0.10.0 2024-04-23

  • Add disabled flag to tile.

  • Add new cadences.

  • Add catalogdb.too_target and catalogdb.too_metadata tables and models.

0.9.0 2024-03-08

  • Added legacy survey sql schema files

  • Added new peewee and sqlalchemy ORMs for astra schema.

  • Add new schema for astra to sdss5db.

0.8.3 2023-12-11

  • Fix hardcoded schema in SQLAlchemy opsdb.overhead model.

  • Add column macro_id to opsdb.overhead.

0.8.2 2023-12-05

  • Change DATE to TIMESTAMPTZ for the datetime columns in opsdb.overhead and models. Fixed the SQLAlchemy Overhead model which was in targetdb by mistake.

0.8.1 2023-12-05

  • Updated GitHub workflows.

  • Added opsdb.overhead table and models for Peewee and SQLAlchemy.

0.8.0 2023-10-23

  • Added new peewee and sqlalchemy ORMs for vizdb schema.

  • Added new schema for vizdb schema in sdss5db.

0.7.0 2023-09-28

  • Added allStar-dr17-synspec_rev1 table and models.

  • Added files to create catalogdb.lvm_magnitude.

  • Added complete SQLAlchemy models for sdss5db.

0.6.6 2023-08-17

  • Added the option to disable database autoconnection by setting sdssdb.autoconnect = False or an environment variable SDSSDB_AUTOCONNECT=false.

0.6.5 2023-08-09

  • Hotfix for a bug introduced in 0.6.4 that would prevent a connection to fail without errors when a profile was not present on import.

0.6.4 2023-08-08

  • Implement fine-grain field priorities

  • Add ‘pipelines’ profile

  • Updates and fixes for cadences and obsmodes

  • Add LVM schema and model classes

  • Add catalogdb.rave_dr6_xgaiae3 (Gaia DR3 cross-match for RAVE DR6).

0.6.2 2023-02-12

  • Speed up loading of reflected tables by caching results except if the table is not found in the schema.

  • Update to allow for v1.0.6 of eROSITA superset catalogues.

  • Rename SagittaEDR3 to Sagitta_EDR3.

0.6.1 2023-01-19

  • Update auto schemas.

  • Add assignmentStatus table to targetdb.

  • Don’t count observed designs in queue.rm.

0.6.0 2022-12-29

  • Many additions to sdss5db, mainly related to target selection v1. See the commit list for details.

0.5.5 2022-09-11

  • [Feature] #127: Add Design.field attribute.

  • Multiple additions to catalogdb for v1.

  • Fix issue with get_database_columns.

  • Update default Cadences to v2.

  • Fixes to opsdb, targetdb.

  • Use full hostname for sdss5-db at APO.

0.5.4 2022-07-15

  • New catalogs: gaia DR3

  • Improve offset support

  • Add targetdb.design_to_field table

0.5.3 2022-05-19

  • New catalogs: gaia eDR3, skies_v2, legacy_survey_dr10a

  • Support opsdb_apo or opsdb_lco depending on OBSERVATORY environment variable

0.5.2 2022-04-01

  • Add manual column to opsdb.design_to_status

  • Add more magnitudes to targetdb

  • Add assignment_hash to targetdb.design

0.5.0 2021-11-16

  • Bug fixes found during commissioning

  • Add targetdb.design_mode_value table

  • Add targetdb.field_reservation and associated peewee util

0.4.13 2021-11-16

  • Minor bug fixes

  • Add mugatu_version, and run_on to targetdb.design

0.4.12 2021-11-16

  • Several major modifications to targetdb and opsdb schemas.

  • Add skies_v2, bailer_jones_dr3, sagitta_edr3, and APOGEE DR17 tables.

0.4.11 2021-10-12

  • Add lco5 profile for LCO.

  • Add targetdb data_table.

  • Do not cache database field. This was causing issues when reflection was used multiple times in the same routine.

  • Add cadence generator scripts, cfg files, and notebook for merging.

  • Fix a bug with the documentation not building with Sphinx 4.

  • Add cadences and engineering design modes.

0.4.10 2021-08-25

  • When calling DatabaseConnection.become, ignore the password stored in the DSN parameters since the user/admin passwords will likely be different.

  • Add run_on field to targetdb.carton.

  • Add default_lambda_eff to targetdb.instrument.

  • Add apql tables to opsdb.

  • Add apo5 profile.

  • Add priority to field table to opsdb

0.4.9 2021-04-19

  • DatabaseConnection.become_admin and become_user now accept a user parameter. If not provided, defaults to the old behaviour (using the admin and user fields in the profile).

  • Add tycid column to Tycho2 to prevent import errors.

  • Add delta_ra, delta_dec and, inertial for CartonToTarget.

0.4.8 2021-03-05

  • Fix name collision in previous version by changing the column_name of TIC_v8 foreign key.

0.4.7 2021-03-05

  • [Feature] #66: Update targetdb schema with changes to cadence, carton_to_target, and others.

  • Change default FK in TIC_v8 for Tycho2.

  • [Bug]: Use refection only if use_reflection=True.

  • Modifications to apogeedb dump.

  • Multiple new tables for sdss5db.catalogdb related to SDSS-V target selection v0.5.

0.4.6 2020-11-12

  • [Feature] #43: Add a database registry

  • Initial schema files for opsdb.

  • Schema files for multiple catalogdb tables in preparation for SDSS-V target selection v0.5.

  • Fix reflection for catalogdb.skies_v1.

  • Added field value to carton_to_target.

  • Initial version of the sdss5db.opsdb schema.

0.4.5 2020-07-12

  • Add single precision float type to the list of Peewee arrays during reflection.

  • Add ForeignKeyField from CatalogToSDSS_DR13_PhotoObj_Primary directly to SDSS_DR13_PhotoObj.

0.4.4 2020-07-07

  • Add DR16 versions of APOGEE tables.

  • Move deprecated tables to deprecated schema in sdss5db.

  • Add catalogdb.gaia_assas_sn_cepheids table.

  • Add lite materialized views to catalogdb.

  • Clear metadata on reconnect.

  • Ensure reflection assigns double type arrays.

  • Use autorollback=True by default in PeeweeDatabaseConnection.

  • Add ForeignKeyField to TIC_v8 where for all models in catalogdb connected to Gaia.

0.4.3 2020-06-05

  • Add position_angle column to targetdb.field.

  • Add z column to targetdb.magnitude.

  • Rename targetdb.program to carton, and survey to mapper. Add priority field in carton_to_target.

  • Add schema for gaia_dr2_ruwe.

0.4.2 2020-05-29

  • Allow to use ReflectMeta.reflect manually even if use_reflection has not been set in Meta.

  • Modify targetdb schema so that magnitude references target instead of the other way around.

  • Use schema-qualified keys for database.models.

  • Add targetdb.version.tag column.

0.4.1 2020-05-18

  • Rename targetdb.version.label and catalogdb.version.version to plan.

0.4.0 2020-05-15

  • [Feature]: A new ReflectMeta metaclass that provides reflection for Peewee models (with some caveats).

  • [Feature]: New framework for writing tests against databases.

  • Use host=localhost when a profile is being used on its own domain.

  • [Bug] #28: Temporarily remove SQLAlchemy implementation of sds5db since it’s not maintained. We may reintroduce it later once the schema is stable.

  • Add PeeweeDatabaseConnection.get_model to retrieve the model for a given table.

  • New tools for database maintenance/internals.

  • New tools for table ingestion.

  • Changes to the schema display tools.

  • Reimplementation of most catalogdb PeeWee model classes for catalogdb using reflection.

  • Many changes to the catalogdb schema files and PeeWee implementation to match the contents to SDSS-V v0 target selection.

  • Write tests either for peewee or sqlalchemy databases.

  • Adds ability to test against real or fake databases.

  • Adds ability to generate fake data based on real database models for tests.

  • Test suite only runs where existing local databases found. Optionally run only peewee or sqlalchemy tests.

  • [Support] #32: Assume that both SQLAlchemy and Peewee will be installed and simplify code.

0.3.2 2020-03-10

  • New schema and models for sdss5db.targetdb.

  • Change operations-test profile to operations using the new machine hostname.

0.3.1 2020-02-24

  • Fix import of mangadb schema in Plate.mangadb_plate.

  • [Bug] #18: Fixed Travis built after migration to using setup.cfg.

  • Added archive database with sas schema.

0.3.0 2019-09-23

  • [Feature] #15: New CLI file2db and associated tools to create and load a table from a file. Also added Numpy adaptors.

  • [Feature] #14: Add support for table DR14Q_v4_4 in catalogdb.

  • [Feature] #16: Changed the package internals to use setup.cfg.

  • [Feature] #13: Add support for schema apogeeqldb in operationsdb.

  • connect now accepts user, host, and port to override the default profile parameters.

  • Updated schema for mangadb.Plate.

  • Added TIC v8.

  • Removed TIC v6.

0.2.2 2019-07-24

  • Update PyYAML requirement to 5.1 and use explicit loader.

  • Improved descriptions in setup.py and README.rst.

  • Added operationsdb SQL schemas.

  • Fixed import of database connections when Peewee or SQLAlchemy are not available.

0.2.1 2018-12-14

  • [Bug]: Remove bin/sdssdb from the list of scripts to install. This was making the build process fail.

0.2.0 2018-12-14

  • [Feature] #7: Added create_schema_graph function to generate schema graphs and use it to auto-generate graphs in the documentation for the supported databases.

  • Improve model __repr__.

  • Use pts_key for fk relationship between TwoMassClean and TwoMassPsc.

  • Use tmass_pts_key for fk relationship between GaiaDR2TmassBestNeighbour and TwoMassPsc.

  • Added mangadb schema for SQLA.

  • Fixed command line example about how to install with sdss_install.

  • Removed some unused files from the template.

0.1.1 2018-12-10

  • Set python_requires='>=3.6'.

0.1.0 2018-12-10

  • Basic documentation.

  • Implemented database connection switching in SQLAlchemy.

  • Support for sdss5db, operationsdb (apodb/lcodb), and manga (only in SQLAlchemy).

  • DatabaseConnection class with Peewee and SQLA subclasses.

  • Initial version.