Skip to content

Changelog

9.1.0 (2024-10-01)

Enhancements

  • validate: reformat input XML data (DEV-4124) (#1164) (45af782)
  • validate: Write SHACL Shapes Turtle File (api-shapes) (DEV-4120) (#1163) (afb2a21)
  • xmllib: new functionality (RDU-38) (#1129) (1dc09f8)
  • xmlvalidate: add cardinalitiy restrictions to resource (DEV-4121) (#1178) (d2536c7)
  • xmlvalidate: get ontologies from API (DEV-4150) (#1171) (2e599bd)
  • xmlvalidate: SPARQL create resource SHACL (DEV-4123) (#1174) (ff550b3)

Bug Fixes

  • excel2json: write newlines correctly into the "description" field of the JSON file (RDU-45) (#1170) (889d11f)
  • ingest-xmlupload: only convert absolute path from mapping CSV to relative path if necessary (#1176) (72ee250)
  • progress bar recovers after resizing the Terminal window (DEV-4110) (#1161) (7b4cc12)
  • start-stack: --latest flag ships latest versions of all backend components, instead of only API (DEV-4100) (#1159) (6bbec2c)
  • xmlupload: allow more URLs (#1177) (f9aa882)
  • xmlupload: increase timeout for file uploads to 10 min (#1169) (a5766ee)
  • xmlupload: subpar output of onto consistency check (DEV-3727) (#1143) (edb58a9)

Maintenance

  • bump ruff (#1172) (e65c753)
  • bump stack to 2024.09.01 (#1183) (28a9f1c)
  • deps-dev: bump the all-dependencies group across 1 directory with 9 updates (#1148) (07910b6)
  • migrate from poetry to uv (DEV-4040) (#1160) (6845b1a)
  • Revert "chore: Fix tests not being executed on release-please branch" (#1158) (3af3d91)
  • xmllib: make dsp built-in resources interface consistent (DEV-4186) (#1182) (1f10fb3)
  • xmlupload: remove lineColor key from geometry value JSON object (DEV-4132) (#1166) (8169cce)
  • xmlvalidate: change qname transformation (#1168) (9efe030)
  • xmlvalidate: change structure of XML deserialisation (DEV-4125) (#1173) (50a35e3)
  • xmlvalidate: rename test fixtures files (#1175) (b023c6d)
  • xmlvalidate: replace value BN with IRI (DEV-4187) (#1181) (1a34288)

Documentation

9.0.2 (2024-09-04)

Maintenance

  • Add comment to CI so that this does not get broken again (#1156) (7e3c2ec)
  • Attempt to fix release issues by bringing back the GH_TOKEN (#1153) (0853e25)
  • Fix release issues by using DASCHBOT PAT (#1154) (4684c91)

9.0.1 (2024-09-04)

Bug Fixes

Maintenance

  • Fix releasing to PyPI (DEV-3972) (#1151) (b1ba08b)
  • Fix tests not being executed on release-please branch (#1152) (325006b)

9.0.0 (2024-09-03)

⚠ BREAKING CHANGES

  • xmlupload: change representation of and in XML due to XSD schema validation problems (DEV-3964) (#1101)

Enhancements

  • xmlupload: add resource type to error message when checking for encoding mistakes (RDU-25) (#1145) (7279b69)

Bug Fixes

  • excel2json-lists: remove erroneous warning if comments column exist (RDU-23) (#1141) (4ed0a7e)
  • excel2json: don't crash if json_header.xlsx is present when using the default command (RDU-24) (#1144) (4c4738e)
  • xmlupload: change representation of <video-segment> and in XML due to XSD schema validation problems (DEV-3964) (#1101) (1476eca)
  • xmlupload: don't rely on requests.Response.json() in case of unsuccessful request (DEV-4035) (#1132) (ff0b1de)

Maintenance

  • bump stack to 2024.08.02 (#1147) (86e764b)
  • don't ignore ARG001 in pre-commit hooks (#1136) (7ea83f7)
  • remove codecov-integration (DEV-4043) (#1142) (042cf06)
  • start-stack: change message for docker prune (DEV-4027) (#1126) (73c7823)
  • surround angular brackets in docstrings by backticks (DEV-4014) (#1135) (7e746e2)
  • turn XMLResource and XMLProperty into dataclasses (#1137) (6c4fe5d)

Documentation

  • excel2xml: fix params of make_hasSegmentBounds_prop() (#1138) (95b7a84)
  • mention fixed order of video/audio segments (#1139) (7ed7b93)

8.5.0 (2024-08-21)

Enhancements

  • exce2xml-lib: make xsd compatible string without uuid (DEV-4026) (#1127) (50ef476)
  • excel2json-lists: enable to add comments to list nodes (RDU-18) (#1111) (54ba206)

Bug Fixes

  • cli: resume-xmlupload --skip-first-resource now works (DEV-3744) (#1084) (7f99287)
  • xmlupload: allow non-prefixed custom groups, and custom groups with dash (DEV-3979) (#1098) (e5a19eb)

Maintenance

  • bump dependencies and fix new linter errors (#1122) (212e6e5)
  • bump stack to 2024.08.01 (#1128) (400ddbe)
  • excel2json-lists: access columns differently (#1109) (154f88f)
  • excel2json-lists: add excel name to lists problem classes (#1089) (6112506)
  • excel2json-lists: add filename to sheet class (#1090) (2f9e30e)
  • excel2json-lists: change error message format (#1118) (f479aa4)
  • excel2json-lists: change find missing translations (#1112) (ab54d96)
  • excel2json-lists: change location of column info extraction (#1115) (bd163cf)
  • excel2json-lists: change paramter to ExcelSheet in functions (#1091) (a4086c2)
  • excel2json-lists: change sorting of columns (#1110) (4670085)
  • excel2json-lists: remove dead check (#1120) (463c992)
  • excel2json-lists: remove file hierarchy from code (#1094) (3b554a3)
  • excel2json-lists: remove file hierarchy from Problem classes (#1093) (56bd84d)
  • excel2json-lists: remove unnecessary checks (#1107) (71339f7)
  • excel2json-lists: wrap file structure in classes (#1086) (e60002a)
  • excel2json-new-lists: change order of functions (#1100) (0b9a429)
  • excel2json-new-lists: extract fixtures for compliance tests (#1104) (f2b05ac)
  • excel2json: lists delete duplicate tests (#1082) (90280c1)
  • github-action: allow referencing RDU tickets in PR titles (RDU-13) (#1095) (c0f360c)
  • new-lists: reorganise files (#1096) (866f6bd)
  • preparation for new <video-segment> (#1125) (57dd646)
  • send X-Asset-Ingested header only when needed (#1117) (a5279f1)
  • small adaptions to docs + docstrings (#1121) (705c2f7)
  • tidy up readme (#1106) (6663276)

Documentation

  • CLI: add flag for IIIF validation in xmlupload in documentation (#1103) (d00f1cf)
  • excel2json: mention old and new at the top (#1123) (cc58c68)

8.4.0 (2024-08-07)

Enhancements

  • excel2json: add option to create header with Excel file (DEV-3898) (#1065) (353d8e9)
  • New workflow for big xmluploads: add commands upload-files and ingest-files (DEV-3905) (#1067) (b4c2912)

Bug Fixes

  • don't use copyrighted testdata any more (DEV-3906) (#1068) (1558408)
  • ingest-xmlupload: allow uppercased file extensions (DEV-3963) (#1075) (51a4703)
  • Urlencode filenames when uploading files to ingesta (DEV-3865) (#1045) (4edfbd3)

Maintenance

  • add logging of requests made in DspIngestClientLive (DEV-3761) (#1064) (84c6101)
  • bump start-stack to 2024.07.02 (#1078) (2a74978)
  • deps: bump the all-dependencies group with 16 updates (#1071) (a893aca)
  • excel2json: change serialisation json header (DEV-3877) (#1046) (f4c6088)
  • excel2json: find duplicate excel sheet names (#1054) (83bb96a)
  • excel2json: generalise InvalidContentInSheetProblem (#1051) (c55603c)
  • excel2json: improve checks for classes sheet in resources.xlsx (#1061) (1839d98)
  • excel2json: move list problems to separate file (#1049) (353c002)
  • excel2json: properties collect problems before raising error (#1063) (5ba6fc1)
  • excel2json: reorder the functions in resources.py (#1060) (6295b02)
  • excel2json: replace ListExcelProblem with ExcelFileProblem (#1052) (b84a185)
  • excel2json: restructure and rename find missing values function (DEV-3909) (#1070) (d42595e)
  • excel2json: serialise property with dataclass (#1059) (0e33238)
  • excel2json: serialise resources with dataclass (#1062) (df11148)
  • excel2json: validate classes sheet in resources.xlsx (#1057) (96b38f7)
  • ignore ARG001 (unused function argument) in .pre-commit-config.yaml (#1066) (06b41d9)
  • performance: add initial k6 excel2json performance test (DEV-3885) (#1056) (3625c62)
  • test: renaming (#1048) (a7f0bca)
  • test: take apart assertions for test_project.py (#1055) (da31d19)
  • upload-files: adapt timeout, so that big files don't fail (#1077) (1f7b43b)
  • xmlupload: video-segment and audio-segment: clarify docs / allow custom creation date (#1076) (1196afc)

Documentation

8.3.0 (2024-07-11)

Enhancements

  • excel2json: creating classes without any cardinalities (DEV-3755) (#1029) (9e19aa1)

Bug Fixes

  • excel2json-lists: assignment of wrong parent ID if the node names are identical (DEV-3844) (#1040) (51af556)
  • harmonize supported file extensions in docs, test data, and prod code (DEV-3788) (#1028) (728b782)
  • new-excel2json: don't crash when Excel files are upper-cased (DEV-3808) (#1032) (2a5cc31)
  • xmlupload: allow angular brackets in SimpleText (DEV-3814) (#1033) (cf8e410)
  • xmlupload: don't omit any stashed links (DEV-3827) (#1037) (20e7eac)

Maintenance

  • Add db configuration to ingest container (#1039) (48e39ea)
  • bump ruff (#1035) (720d7e9)
  • bump start-stack to 2024.07.01 (#1043) (af6ad29)
  • create: inform user that project membership has to be assinged manually (DEV-3800) (#1030) (5494267)
  • deps: bump certifi from 2024.6.2 to 2024.7.4 (#1041) (550b1cf)
  • deps: bump the all-dependencies group with 12 updates (#1036) (797f351)
  • don't crash when offline (#1034) (c39d610)
  • downgrade pytest, until Assertion Rewriting is fixed (DEV-3786) (#1026) (d2c8ede)
  • downgrade pytest, until Assertion Rewriting is fixed (DEV-3786) (#1038) (d8d8d72)
  • Enable erasing projects locally (#1042) (807db71)
  • improve error messages according to consulting with RDU (#1031) (e9c9507)

8.2.0 (2024-06-19)

Enhancements

  • add flag to suppress warning when using old dsp-tools version (DEV-3707) (#1001) (e28ba2e)
  • display progress in xmlupload as progress bar (DEV-3708) (#1022) (4ccf628)

Bug Fixes

  • ci: bump release-please action (DEV-3526) (#992) (891a889)
  • ci: fix flaky CI tests in rosetta repo (DEV-3733) (#990) (544923f)
  • ci: fix release-please (DEV-3730) (#999) (4798d77)
  • ci: move changelog (DEV-3730) (#1000) (0fae3e7)
  • ci: use GITHUB_TOKEN instead of GH_TOKEN, move CHANGELOG.md back (DEV-3730) (#1002) (1f149de)
  • excel2xml: support backslash in make_text_prop() (DEV-3377) (#991) (6e301d0)
  • excel2xml: support named character references in make_text_prop() (DEV-3738) (#1007) (324c00a)
  • remove GH_TOKEN from release workflows (DEV-3737) (#1006) (1c4f6f1)
  • start-stack: fix display issue in DSP-APP on localhost (DEV-3745) (#1008) (b2d51ca)
  • xmlupload: OntologyConstraintException should not interrupt an xmlupload (DEV-3724) (#995) (50ab6bf)

Maintenance

  • add yamlfmt to pre-commit (#1009) (569c161)
  • bump start-stack to 2024.06.01 (#1024) (991c6bc)
  • ci: after every PR merge, upload test coverage report for main (DEV-3731) (#1010) (c76b787)
  • ci: only post codecov comment if coverage changes (#1015) (8bee0ec)
  • deps-dev: bump the all-dependencies group with 6 updates (#998) (99ef810)
  • deps: bump the all-dependencies group with 4 updates (#1013) (5a1ac6e)
  • deps: bump urllib3 from 2.2.1 to 2.2.2 (#1023) (bac6c69)
  • fix some low-hanging linter warnings (#1019) (70beea3)
  • fix typo (#1018) (df59932)
  • replace deprecated PR title checker (DEV-3750) (#1016) (e4cd784)
  • start-stack: don't print that stack is ready before it is ready (#997) (9317df2)
  • test: add typing for test_ingest.py (#1020) (c959d31)
  • use yamllint (#1011) (ddb47fd)
  • xmlupload: serialise boolean value (DEV-3713) (#988) (92d3c64)

Documentation

  • fix hierarchy of headings in cli-commands (#1012) (210965d)

8.1.0 (2024-06-04)

Enhancements

  • add IIIF image support (DEV-3507) (#946) (aa3eabb)
  • xmlupload: interrupt if a resource cannot be created due to server failure (DEV-3444) (#954) (debc0b3)

Bug Fixes

  • xmlupload: improve ingest performance by reusing session (DEV-3714) (#986) (d818f5d)

Maintenance

  • deps: bump the all-dependencies group with 9 updates (#984) (1611d65)
  • fix poetry exec clean (#983) (1721b1c)
  • start-stack: print useful error if Docker is not running (#980) (25c036c)
  • start-stack: remove network from docker-compose.yml (#981) (ea6fa08)
  • start-stack: remove unnecessary config from docker-compose.yml (#982) (549d053)
  • update dependencies (#977) (9473a7e)

Documentation

  • create: fix: descriptions are required in JSON (#985) (00c8072)

8.0.0 (2024-05-22)

⚠ BREAKING CHANGES

  • add support for video and audio segments, remove isSequenceOf and standalone interval value (DEV-3439) (#933)

Enhancements

  • add support for video and audio segments, remove isSequenceOf and standalone interval value (DEV-3439) (#933) (391da7f)

Bug Fixes

  • excel2json: erroneous groupby in new-excel2json lists (DEV-3660) (#963) (46fbe95)
  • excel2json: resources don't crash if optional columns are missing (DEV-3516) (#974) (db2df0a)
  • mypy: prevent possibly unbound variables (DEV-3657) (#962) (1be2259)
  • xmlupload: permission for uri value serialise (DEV-3630) (#958) (79a11bb)

Maintenance

  • bump start-stack to 2024.05.02 (#975) (6c02a6a)
  • deps: bump requests from 2.31.0 to 2.32.0 (#972) (092d4f7)
  • do not use ingest client in bulk upload scenario (DEV-3665) (#966) (8614bbe)
  • fix unbound variable error (#961) (7c41507)
  • reduce number of arguments in some functions (#967) (f38f6b4)
  • ruff: Update ruff to 0.4.4 (#951) (316a736)
  • streamline shared logic between upload workflows (#969) (17750e0)
  • Use dsp-ingest instead of sipi for upload of assets (DEV-3620) (#959) (c797010)
  • xmlupload: add serialise value for URI (DEV-3624) (#955) (0289294)
  • xmlupload: disallow +/- in interval property (#952) (871f312)
  • xmlupload: handle error wider above in the call stack (#960) (c7ba637)
  • xmlupload: refactor resource creation (#917) (cdad095)
  • xmlupload: reorganise models file (#953) (6d90b8f)
  • xmlupload: serialise int value with rdflib (DEV-3626) (#957) (0150fd6)
  • xmlupload: value models (#949) (c69c963)

7.2.0 (2024-05-08)

Enhancements

  • excel2xml: if value is not valid, print warning instead of raising an error (only where it is possible) (DEV-3571) (#938) (3ae536d)
  • new-excel2json: new lists section and excel (DEV-3462) (#916) (92cf58d)
  • start-stack: make pre-loaded projects on localhost optional (DEV-3560) (#932) (d8ab847)

Bug Fixes

  • warning_config recursive calls (DEV-3542) (#929) (20b8517)

Maintenance

7.1.3 (2024-04-24)

Bug Fixes

  • allow slashes and semicola in query part of URL (DEV-3480) (#910) (af02895)

Maintenance

Deprecated

7.1.2 (2024-04-10)

Bug Fixes

  • excel2json: if gui_order is empty no warning is longer displayed (DEV-3469) (#908) (a278e3e)
  • excel2properties no longer crashes if optional columns are missing (DEV-3468) (#907) (523d55b)

Maintenance

  • add type annotations for pandas and networkx (#896) (bb0b3c6)
  • bump start-stack to 2024.04.01 (#905) (04faeec)
  • deps: bump the all-dependencies group with 10 updates (#894) (0e66199)
  • remove .gitmodules file (#897) (64e4fe3)
  • set api log level in docker-compose.yml (#899) (2a8d574)

Documentation

7.1.1 (2024-03-27)

Maintenance

  • bump start-stack to 2024.03.02-hotfix (#892) (d4733c6)

7.1.0 (2024-03-27)

Enhancements

  • excel2xml: allow for single tags in XML text (DEV-3427) (#885) (c73b126)
  • save warnings and errors in second file with loguru (DEV-3406) (#883) (7818325)

Bug Fixes

  • create: fix crash when no project is on the server new error (DEV-3420) (#882) (ca9a674)
  • xmlupload: don't stop xmlupload when resource is wrong (DEV-3419) (#880) (86795ec)

Maintenance

Documentation

  • reformulate text-property and gui element (#890) (8d7bb79)

7.0.0 (2024-03-13)

⚠ BREAKING CHANGES

  • remove --verbose flag from xmlupload (DEV-3389) (#869)

Enhancements

  • prompt before continuing when using an outdated version (DEV-3350) (#850) (38907fa)
  • remove --verbose flag from xmlupload (DEV-3389) (#869) (1e2e170)
  • resume an interrupted xmlupload (DEV-3323) (#853) (4acf841)
  • resume-xmlupload: add option to skip the first resource (DEV-3412) (#878) (a53785f)

Bug Fixes

  • add "packaging" as dependency (DEV-3368) (#856) (81508b0)
  • create: fix crash when no project is on the server (DEV-3405) (#875) (9607799)
  • don't retry on 404 project not found (DEV-3362) (#857) (5c19f60)
  • don't retry on errors in the 400 range (DEV-3349) (#877) (c543274)
  • ingest: ingest container must be part of knora-net (DEV-3370) (#858) (cd018ee)
  • pypi: prevent that PR merged into PR is published to pypi (DEV-3394) (#871) (3d5e071)
  • release-please: adapt version check (DEV-3363) (#854) (d04b731)
  • resume-xmlupload: make it impossible to resume after all resources have been created (DEV-3398) (#865) (8aa5d30)
  • resume-xmlupload: make resource counting more user friendly (DEV-3397) (#864) (2b5295d)
  • xmlupload: don't crash if the project has more than 50 errors (DEV-3364) (#855) (a0be38e)
  • xmlupload: don't loose elements when stashing standoff properties (DEV-3151) (#870) (c8e8966)
  • xmlupload: exit with code 0 if xmlupload finishes with batch (DEV-3396) (#863) (8a15973)
  • xmlupload: fix xmlupload text as xml when uploading stash (DEV-3361) (#851) (79a643a)

Maintenance

  • bump start-stack to 2024.03.01 (#879) (b1c8262)
  • connection: call specific error response codes (DEV-3339) (#832) (d8531bd)
  • deps-dev: bump the all-dependencies group with 5 updates (#849) (4c8b942)
  • excel2xml: better error message for invalid text values (#861) (914acd8)
  • fix test_xml_validation_low_level.py (#837) (3e758c7)
  • project create: add erroneously removed exc_info in logging (DEV-3294) (#866) (19d1f25)
  • ruff reformatting (#867) (5ed62fc)
  • ruff.lint.isort: force-single-line (#840) (fb3c1d9)
  • test: make integration test excel2json (#841) (e5b0206)
  • test: make integration test excel2xml (#842) (8b12f8b)
  • test: make integration test general commands (#846) (0e61eef)
  • test: make integration test ingest-xmlupload (#843) (fb58779)
  • test: make integration test project (#844) (a7e0fc6)
  • test: make integration test utils (#847) (089c41d)
  • test: make integration test xmlupload (#845) (f80cc90)
  • xmlupload (#852) (c8e6284)

Documentation

  • add guarantee note for resume-xmlupload (#868) (8747edd)
  • excel2xml: code examples in docstrings: prepend function names with their namespace (#859) (7923a8c)

6.0.0 (2024-02-28)

⚠ BREAKING CHANGES

  • Remove fast-xmlupload command (DEV-3324) (#830)

Enhancements

  • Remove fast-xmlupload command (DEV-3324) (#830) (0c9d077)
  • xmlupload: check if text encoding in data conforms to type specified in ontology (DEV-3279) (#821) (449f780)
  • xmlupload: check if the encoding in the text-prop is consistent (DEV-3296) (#818) (4ae8469)

Bug Fixes

  • don't crash when dsp-tools is run offline (DEV-3338) (#833) (901b86d)
  • excel2json: allow resources to have no cardinalities (DEV-3333) (#834) (b55224a)

Maintenance

  • bump start-stack to 2024.02.02 (#836) (f83ce78)
  • correct docs in regard to gui-element of hasComment (#816) (3f869d9)
  • fix typo in check_consistency_with_ontology.py (#813) (bc01027)
  • ontology_client: make retrieval of ontologies more flexible (DEV-3308) (#820) (327f61e)
  • refactor validate xml in preparation for extension (#814) (652aa9f)
  • remove docker as dependency (#835) (7f98945)
  • renaming functions of ontology checks in xmlupload (#817) (e6b0e7d)
  • test_xmlupload: separate tests (#824) (7333136)
  • test: add pytest entrypoint (#823) (e31da78)
  • test: test_shared.py turn into pytest (#826) (46e7743)
  • test: test_upload_stashed_xml_texts.py turn into pytest (#825) (755323f)
  • test: turn into pytest test_xmlupload.py (#827) (c0d1c97)
  • test: turn xml_utils.py into pytest (#828) (e97084f)
  • update data.xsd regarding TextValue encoding for hasComment (#811) (af86b94)
  • xml_validation: turn into pytest (#815) (516a2de)
  • xmlupload: improve parse xml function (#819) (9947607)

Documentation

  • DSP-API uses "just" instead of "make" (DEV-3212) (#753) (d5c8f97)

5.8.1 (2024-02-14)

Maintenance

  • bump start-stack to 2024.02.01 (#806) (9080f47)
  • models-project: remove all project update code (#802) (1aa39a1)
  • models-user-project: delete dead code (#800) (12813bc)
  • remove dead parameter in ontology client (#809) (8095ba3)
  • remove sourcery (#805) (c3ccc36)
  • rename value.py file into formatted_text_value.py (#807) (90af390)
  • renaming functions in preparation for TextValue verification (#808) (9f06f3f)
  • test-create-project: turn unittests into pytests (#804) (8c667a6)

5.8.0 (2024-02-01)

Enhancements

  • excel2json: add optional column "subject" to properties.xlsx (DEV-3253) (#777) (cf491e9)

Bug Fixes

  • don't crash if pip is not found (DEV-3256) (#791) (15f6e31)
  • xmlupload: don't retry on OntologyConstraintException (DEV-3255) (#783) (ef577ac)

Maintenance

  • bump start-stack to hotfixed 2024.01.01 (#801) (b721fdd)
  • delete dead code fragments (#792) (c5b9872)
  • deps: bump the all-dependencies group with 8 updates (#787) (0c1a5e2)
  • excel2json-lists: fix two ruff PLW0603 (#778) (5f53c38)
  • model-project: fix one ruff PLR0912 (#782) (25ad02d)
  • models-group: delete unnecessary action object (#794) (24fdc9f)
  • models-listnode: delete actions object (#795) (f7a2ec9)
  • models-listnode: delete dead code (#797) (fea23fd)
  • models-ontology: delete actions object (#796) (28299fa)
  • models-project: delete dead code (#798) (dcdbaaf)
  • models-propertyclass: fix PLR0912 (#784) (51d4265)
  • models-resourceclass: fix ruff PLR0912 (#788) (ed10c27)
  • models-user: fix three ruff PLR0912 (#780) (820fc25)
  • project_client: delete dead code (#793) (b5963de)
  • project_validate: fix one ruff PLR0912 (#781) (9ccd2a7)
  • propertyclass-resourceclass: delete dead code (#799) (d17b656)
  • remove dead code with vulture (#790) (aba9aef)
  • remove ruff ignore PLR0912 (Too many branches) (#789) (e93b049)
  • test_create_get_xmlupload: fix one ruff PLR0912 (#785) (c09c0c6)
  • use pytest's tmp_path fixture (#786) (c01a08f)

5.7.0 (2024-01-31)

Enhancements

  • excel2xml: find_date_in_string(): allow time spans of 1 day (DEV-3154) (#720) (59b5d16)
  • excel2xml: make_bitstream_prop(): make file existence check opt-in (DEV-3113) (#709) (1f68943)
  • excel2xml: support 2-digit-years in find_date_in_string() (DEV-2633) (#711) (15d3493)
  • ingest-upload: create new ingest xmlupload cli command (DEV-3019) (#670) (5745190)
  • ingest-xmlupload: add support for dumping HTTP requests (DEV-3167) (#729) (a02dda5)
  • option for custom headers in HTTP requests (DEV-3145) (#702) (0cbc78a)

Bug Fixes

  • add termcolor as main dependency (DEV-3149) (#706) (4f6cd6d)
  • don't retry login when credentials are invalid (DEV-3224) (#763) (41d8217)
  • excel2xml, xmlupload: allow commas in URLs (DEV-3183) (#742) (1ee6e36)
  • excel2xml: make_text_prop: allow <, >, & in rich texts (DEV-3131) (#691) (228c79f)
  • fix wrong resolution of merge conflict (DEV-3161) (#726) (c81c94d)
  • fully mask passwords in logfile (DEV-3225) (#761) (87c03d4)
  • include stack trace in log file (DEV-3157) (#723) (9046792)
  • increase timeout to prevent doubled resources (DEV-3114) (#698) (930df8f)
  • ingest-xmlupload: apply mapping.csv even if extension has wrong casing (DEV-3197) (#749) (bac7c79)
  • ingest-xmlupload: file check: handle absolute vs. relative paths, save feedback file correctly (DEV-3162) (#727) (c6d2169)
  • prevent crash when venv isn't activated correctly (DEV-3233) (#765) (6d339ed)
  • properly log requests and their responses (DEV-3186) (#745) (8296254)
  • restore authorization header after ConnectionError (DEV-3190) (#744) (d03be2a)
  • retry mechanism again catches return codes in the 500 range (DEV-3177) (#740) (c927c21)
  • xmlupload: retry on all non-OK response statuses (DEV-3214) (#754) (b85e806)

Maintenance

  • add PermanentConnectionError to make BaseError slimmer (DEV-3192) (#741) (ed60319)
  • add permission to test data (#768) (a4d93fc)
  • add ruff rule to prevent TODO comments (#738) (e897496)
  • add User-Agent header to HTTP requests (#737) (85e363b)
  • avoid mutable default values in class attributes (DEV-3234) (#764) (1d9e5de)
  • bump all dependencies (#734) (d3e238b)
  • bump GitHub actions that use a deprecated NodeJS version (#766) (84e8ec0)
  • bump start-stack to 2024.01.01 (#771) (2997c05)
  • ci: move setup into reusable workflow (#715) (a3799ce)
  • ci: revert changes related to merge queue (#719) (ff0e4fe)
  • ci: set up merge queue (#717) (1c13f5f)
  • connection: content type doesn't have to be parametrized (#752) (2c0febb)
  • create: in normal workflow, don't rely on failing request (DEV-3220) (#757) (f9b9677)
  • define poetry exec targets for all tools (#695) (c04356b)
  • delete dead code in project context (#770) (5159b8d)
  • don't log errors multiple times (DEV-3195) (#769) (0025784)
  • don't send chat notification on post releases / release only on "feat" or "fix" (DEV-3148) (#707) (fd9b148)
  • excel2json-properties: reorganise file (#776) (4b8c060)
  • fix pypi.org publishing (#708) (ea56066)
  • fix ruff PLR5501 (#774) (1f88112)
  • get rid of dead code (#751) (f67eac2)
  • get rid of http_call_with_retry (#694) (70f6808)
  • get rid of shared.login() function (#714) (28806a0)
  • hide stack trace from user (DEV-3158) (#724) (808c01c)
  • improve package structure of unittests/cli (#713) (111c6df)
  • improve performance with requests.Session object (DEV-3174) (#739) (43caaf9)
  • log all HTTP requests, get rid of --dump flag (DEV-3171) (#731) (e2b0598)
  • log all requests, also during retry (DEV-3213) (#759) (fd05080)
  • make dev-release to pypi.org on every commit to main (DEV-3130) (#699) (b05690b)
  • make post releases instead of dev releases (DEV-3130) (#705) (94b289d)
  • make XmlUploadError a subclass of BaseError (#746) (12e406f)
  • move session renewal into own method (#755) (7adc837)
  • move to Python 3.12 (#696) (60f64a2)
  • project_validate: fix one ruff PLR0912 (#775) (d7060d6)
  • project-create: clean up one ruff PLR0912 and one PLR0913 (#772) (7902840)
  • project-get: fix ruff PLR0915 (#773) (71b9b2a)
  • PyPI authentication via API token (DEV-3143) (#703) (dd16ef4)
  • refactor test_find_date_in_string (#710) (630df2c)
  • remove duplicated & outdated docstrings from Connection protocol (#758) (2a04f5a)
  • remove unused code (DEV-3152) (#712) (43cba62)
  • replace bandit action by ruff's bandit ruleset (DEV-3026) (#722) (76203cf)
  • resolve PLR0911 in call_requested_action() (#701) (855231e)
  • split up models/helpers.py (#760) (f97cce8)
  • tidy up connection class (#747) (eaa1158)
  • tidy up Connection class (DEV-3191) (#748) (bd915ef)
  • tidy up exceptions (#762) (03213ed)

5.6.0 (2023-12-19)

Enhancements

  • excel2xml: support French BC dates in find_date_in_string() (DEV-3099) (#680) (610f064)

Bug Fixes

  • excel2json: support uppercase classes sheet in resources.xlsx (DEV-3109) (#683) (71205f8)
  • excel2xml: find_date_in_string() must not return invalid date (DEV-3116) (#688) (71b754d)
  • xmlupload: saving the csv file if there are more than 50 problems with the ontology names (DEV-3112) (#685) (a7d2e59)

Maintenance

  • add pytest-sugar (#692) (1d22716)
  • downgrade start-stack to 2023.11.02 (#693) (09f50ff)
  • move retry logic into the connection implementation (DEV-3110) (#686) (f1a7051)
  • replace pylint, isort, black with ruff (DEV-2972) (#653) (2594d36)
  • resolve Ruff warnings A003, B023, D103 and PLR0911 (#684) (b0f598c)
  • start-stack: adapt docs of --max_file_size flag (DEV_3093) (#689) (af46da8)

5.5.0 (2023-12-13)

Enhancements

  • cli: change user output when handling errors (DEV-3067) (#672) (71a1737)
  • excel2json: new error implementation for json validation (DEV-3047) (#664) (fdbc545)
  • excel2json: new user error (InputError) implementation in properties section (DEV-3037) (#654) (b1703e1)
  • xmlupload: improve error message if ontology is unknown (DEV-3024) (#674) (5319ff3)

Bug Fixes

  • date validation forbids legal values (DEV-3059) (#668) (13131ff)
  • excel2json: find hidden worksheets in excel (DEV-1483) (#679) (ffbf0c0)
  • xmlupload: allow dots in filenames (DEV-3058) (#676) (ad0c37c)
  • xmlupload: allow external link in text value (DEV-3054) (#666) (08f7b93)
  • xmlupload: support uppercase file extensions (DEV-3095) (#678) (24cb320)

Maintenance

  • bump start-stack to 2023.12.01 (DEV-3105) (#681) (ddd0078)
  • cli: modularise cli.py (DEV-3068) (#673) (f0da1ca)
  • deps: bump the all-dependencies group with 8 updates (#662) (6e307c2)
  • docs: fix outdated link (#669) (5b333c2)
  • excel2json: modularise unittests (DEV-3040) (#659) (107b1b0)
  • excel2json: new excel reader (DEV-3049) (#665) (a0d5776)
  • pandas future warning in unittest (DEV-3060) (#671) (b3f75f4)
  • process-files: diverse improvements (#656) (692ad40)
  • remove tabs (DEV-3043) (#661) (286abf8)
  • update poetry.lock (DEV-3081) (#675) (cd85836)
  • xmlupload: clean up handle media information (DEV-3086) (#677) (93fb71f)

5.4.0 (2023-11-29)

Enhancements

  • xmlupload: check consistency with ontology on server (DEV-2921) (#630) (a563c07)

5.3.0 (2023-11-29)

Enhancements

  • excel2xml: add support for 3-digit-years in find_date_in_string() (DEV-3005) (#652) (1afee03)

Bug Fixes

  • process-files: fix resource leak, try omitting restart of python (DEV-2986) (#651) (7347be7)
  • upload-files: use a new ThreadPoolExecutor for every batch (DEV-2973) (#650) (431a755)

Maintenance

5.2.0 (2023-11-15)

Enhancements

  • xmlupload: add check if links point to valid resource ID (DEV-2902) (#639) (803c9f6)
  • xmlupload: id2iri mapping contains servername (DEV-1889) (#628) (19a3f29)

Bug Fixes

  • retain value permissions if a link gets stashed because of circular dependencies (DEV-1489) (#623) (3ccb75b)
  • upload-files: handle JSONDecodeError (DEV-2907) (#621) (40000a8)
  • upload-files: prevent crash (DEV-2918) (#626) (19d179e)
  • xmlupload: fix non-initialized variable (DEV-2922) (#629) (afb16b1)
  • xmlupload: print reason of failure if resource cannot be created (DEV-2925) (#637) (e3a194a)

Maintenance

  • add clean script to remove unnecessary files (#631) (7f98045)
  • add more logs and timestamps (#627) (21ed1d8)
  • bump start-stack (apply DSP-APP fix) (#641) (f901399)
  • bump start-stack to 2023.11.01 (#633) (81daf2a)
  • excel2xml: suppress irrelevant warnings, turn non-fatal errors into warnings (DEV-2917) (#625) (b6943a2)
  • remove unused code (DEV-2950) (#638) (fbbafec)
  • reorganize excel2xml (#635) (6773513)
  • reorganize excel2xml unit tests (#636) (d015f9f)
  • replace resource instance factory (DEV-2876) (#594) (906a211)
  • restructure repository (#632) (8a05b2c)
  • restructure stash-related files (#640) (a49fa59)
  • upload-files: thread-safe logging of bullet point lists (#619) (37040a6)

Documentation

  • replace admin.dasch.swiss by app.dasch.swiss (#634) (ae06161)

5.1.0 (2023-11-01)

Enhancements

  • xmlupload: reduce stash size of circular references (DEV-2848) (#599) (228b1f7)

Bug Fixes

  • don't create logging handler multiple times (DEV-2891) (#609) (e6aa47c)
  • ignore IRIs in stashing algorithm (DEV-2885) (#603) (635bc5c)
  • IRI regex used in multiple places is incorrect (DEV-2888) (#606) (096f47e)
  • prevent endless waiting for response, without creating resources multiple times (DEV-2860) (#586) (caa16b7)

Maintenance

  • add a client for project related API requests (DEV-2890) (#610) (e100b26)
  • add logging to stashing algorithm (DEV-2881) (#608) (736f02b)
  • add specific model for bitstream information (DEV-2893) (#613) (8d0d61d)
  • bump start-stack to 2023.10.03 (#616) (213c301)
  • deps: bump the all-dependencies group with 8 updates (#617) (1a2fdd6)
  • fix analyse_circles_in_data() (remove namespaces) (#598) (72f710c)
  • fix logging statements (#611) (1f95f8d)
  • further refactoring of graph analysing (#590) (d0779ac)
  • improve logging for upload-files (#614) (f99e755)
  • log dsp-tools version (#612) (ab9ffef)
  • refactor graph analysing (#589) (14a6e83)
  • split up test_rosetta.py into smaller functions (#601) (33c9fce)
  • test_construct_and_analyze_graph: remove namespace, add semantic line breaks (#602) (b693a94)
  • tidy up graph analyzing (#595) (f2d4488)
  • tidy up KnoraStandoffXml class (#597) (c430b67)

Documentation

5.0.3 (2023-10-20)

Bug Fixes

  • xmlupload: misleading warning when uploading stashed XML texts (DEV-2793) (#559) (1e2c8f2)

Maintenance

  • bump dependencies (#578) (6d9f082)
  • bump start-stack to 2023.10.02 (#584) (37ca185)
  • bump start-stack to 2023.10.02 (DEV-2823) (#571) (863c631)
  • CI: split up test action into several jobs (#553) (cfb5042)
  • clarify isort and pre-commit in readme (DEV-2781) (#549) (e58fec1)
  • create composite setup action and allow more PR titles (#550) (2084999)
  • create JSON-LD context without API request (DEV-2845) (#581) (dcc655d)
  • create specific objects for stash information (DEV-2787) (#557) (b38c2d3)
  • deps: bump urllib3 from 2.0.6 to 2.0.7 (#575) (a41b174)
  • identify temporary text values with UUID instead of text hash (DEV-2790) (#558) (08624b2)
  • integrate DSP-INGEST in start-stack (#566) (e8fb38b)
  • introduce abstraction layer for connection (DEV-2820) (#570) (87c1e18)
  • modularize xmlupload (DEV-2813) (#568) (8026fcb)
  • modularize xmlupload method (DEV-2836) (#574) (b9588c3)
  • remove leftovers of old --metrics flag (#583) (3234318)
  • remove use of XMLResource in stash models (DEV-2843) (#577) (05dc486)
  • start-stack: downgrade DSP-APP (#576) (8c109e4)
  • use sets instead of lists for stashing circular references (DEV-2771) (#548) (68605bd)
  • xmlupload: optimize stash links (DEV-2847) (#573) (1d20fad)
  • xmlupload: split up get resources and permissions function (DEV-2796) (#560) (02eff6b)

Documentation

  • xmlupload: day-precision dates should be written with end date (DEV-2802) (#564) (c69af60)

5.0.2 (2023-10-05)

Bug Fixes

  • fast-xmlupload: CLI-command in documentation has outdated information (DEV-2779) (#545) (334ea49)
  • ModuleNotFoundError when importing logging due to identical file name (DEV-2708) (#530) (d2c6ec8)
  • xmlupload: fix performance slowdown during stash applying (DEV-2717) (#533) (add40b2)

Maintenance

  • add isort check in pre-commit and GitHub CI (DEV-2707) (#529) (89ef086)
  • add logging statements to "create" command (DEV-2776) (#544) (73183c4)
  • bump start-stack to 2023.10.01 (DEV-2748) (#546) (3240d5d)
  • deps: bump dependencies (#535) (bf93bc8)
  • deps: bump dependencies (#537) (cbcd2f3)
  • harmonize timestamps between terminal output and log file (DEV-2716) (#534) (9160eea)
  • remove unnecessary PR template (DEV-2691) (#525) (e2c41ec)
  • use faster black in pre-commit hook (DEV-2736) (#536) (ad00e4b)
  • xmlupload: _upload_stashed_xml_texts (DEV-2710) (#532) (9d2dd35)
  • xmlupload: create new directory and move scripts (DEV-2715) (#538) (6bad8d0)
  • xmlupload: file upload_stashed_resptr_props.py (DEV-2774) (#542) (422bbb3)
  • xmlupload: file xmlupload.py (DEV-2775) (#543) (16fefae)
  • xmlupload: modularise individual functions in file read_validate_xml_file.py (DEV-2767) (#541) (dc5c5a7)

Documentation

  • xmlupload: invalid example: properties must be unique (DEV-2711) (#531) (5f9060f)

5.0.1 (2023-09-20)

Bug Fixes

  • excel2json: correct row number in error message (DEV-2650) (#513) (03a59ee)
  • excel2json: don't crash if optional columns are deleted in "properties" Excel file (DEV-2652) (#518) (09c3940)
  • id2iri mapping is written with a question mark after the file extension (DEV-2670) #522 (3fc1bb9)
  • no-op test that doesn't test anything (DEV-2655) (#517) (76f1db2)
  • upload-files: close file handle before handling error (DEV-2666) #519 (439a139)

Maintenance

  • bump start-stack to 2023.09.02 (DEV-2690) (#524) (6f5b935)
  • documenation cleaning (DEV-2602) (#503) (52485c0)
  • excel2json: replace BaseError with UserError (DEV-2671) (#523) (eaf8dd6)
  • excel2json: replace excel reader in excel2resources (DEV-2668) (#520) (f2f0d4e)
  • fix gui_attributes notation (DEV-2651) (#514) (8c97cc3)
  • improve PR title checking regex (DEV-2635) (#509) (c25f3b7)
  • pandas deprecated .applymap (DEV-2617) (#510) (925b13d)
  • pandas deprecates inplace parameter (DEV-2618) (#511) (8d6d3f7)
  • small corrections (DEV-2653) #515 (99db5f1)
  • xmlupload: split up _check_consistency_with_ontology() into smaller functions (DEV-2669) (#521) (79a50cf)

5.0.0 (2023-09-06)

⚠ BREAKING CHANGES

  • xmlupload: allow both IDs and IRIs, remove --incremental flag (DEV-1339) (#494)
  • refactor id2iri: remove --outfile and --verbose flags (DEV-2576) (#488)

Enhancements

  • add --dump flag to "xmlupload" and "get" commands (DEV-2534) (#502) (d9aeba9)
  • get project without credentials (DEV-841) (#504) (b5ea3e9)
  • id2iri: add flag to remove created resources from XML (DEV-2571) (#491) (bf25cb7)
  • id2iri: replace IDs also inside salsah-links, not only inside <resptr> tags (DEV-2578) (#490) (047ba15)
  • xmlupload: allow both IDs and IRIs, remove --incremental flag (DEV-1339) (#494) (df1cf13)

Bug Fixes

  • process-files: default value of batchsize is too big (DEV-2573) #486 (b1775a9)
  • process-files: remove docker container before starting / add user feedback (DEV-2601) (#505) (8e1b77c)
  • process-files: the derivatives are created only at the end (DEV-2625) (#507) (1934403)
  • xmlupload: provide a helpful error message if default-ontology in XML file doesn't exist (DEV-2577) #489 (7b20ad8)
  • xmlupload: sanitize textvalues: remove whitespaces and newlines (DEV-2569) (#484) (d6c8110)

Maintenance

  • bump start-stack to 2023.09.01 (DEV-2630) (#508) (d28f2d8)
  • deps: bump the all-dependencies group with 3 updates (#501) (f4f6ff8)
  • excel2json (DEV-2547) (#487) (504a4ec)
  • improve release-please YAML file (DEV-2599) #492 (82b3b82)
  • mute warnings in tests / update gitignore (DEV-2609) #498 (03e19d7)
  • refactor id2iri: remove --outfile and --verbose flags (DEV-2576) (#488) (f814667)
  • refactor models/connection.py (DEV-2534) (#495) (a9caf98)
  • refactor process-files (DEV-2623) (#506) (7595846)
  • rename excel_to_json to excel2json (DEV-2604) #496 (5a31d5d)
  • run unit tests earlier in GitHub CI (DEV-2600) #493 (00d5ed6)
  • some small bug fixes and improvements (DEV-2564) (#483) (ecd09e9)
  • use typing.TypeGuard for check_notna() (DEV-2608) #497 (2c4e2f8)

4.0.0 (2023-08-22)

⚠ BREAKING CHANGES

  • harmonize CLI flags, rename CLI entry point and add tests for the CLI (DEV-2525) (#463)

Bug Fixes

  • fix bandit workflow configuration (DEV-2536) #470 (4fd6a10)
  • Make gui_attributes Mandatory for Spinbox in JSON Schema (DEV-2556) (#478) (671d846)
  • process-files: in case of Docker API error, don't processes files a second time (DEV-2533) #468 (bace9aa)
  • upload-files: handle server error, document how to circumvent resource leak (DEV-2528, DEV-2527) (#464) (7aa7106)

Maintenance

  • bump start-stack to 2023.08.02 (DEV-2561) #482 (84fb0a9)
  • configure bandit security checks (DEV-2532) (#466) (28a4907)
  • deps: bump dependencies #467 (a488161)
  • deps: bump dependencies #473 (57aa687)
  • diverse refactorings (DEV-2559) (#480) (e29299b)
  • explain in readme that imagemagick and ffmpeg must be installed for local testing (DEV-2558) #479 (a000ab3)
  • fix bandit: always exit with 0 (DEV-2536) #476 (c5351b4)
  • harmonize CLI flags, rename CLI entry point and add tests for the CLI (DEV-2525) (#463) (c1218d6)
  • lint XML models (DEV-2560) (#481) (f2e4c88)
  • move to Python 3.11 (DEV-2524) #461 (74a93e5)
  • refactor models.bitstream (DEV-2538) #472 (6e2deff)
  • replace re by regex (DEV-2531) (#465) (8ac8c99)
  • use darglint to check if the docstrings match the actual implementation (DEV-2530) (#453) (8183235)

Documentation

3.0.0 (2023-08-08)

Enhancements

  • create: in property definitions of JSON files, accept references to list labels (DEV-2247) (#460) (1529330)

Bug Fixes

  • upload-files, fast-xmlupload: handle multiple pickle files (DEV-2500) (#451) (98f0b97)

⚠ BREAKING CHANGES

  • replace gui_element Slider by Spinbox, remove gui_element SimpleText for intervals, et al. (DEV-2501) (#452) (5e668f0)

Maintenance

  • bump start-stack to 2023.08.01 (DEV-2514) #458 (65f2719)
  • create: apply law of Demeter (DEV-2515) (#459) (46cdf19)
  • deps-dev: bump the all-dependencies group with 2 updates (#454) (57527cd)
  • deps: bump dependencies #456 (15096e7)
  • handle timeout errors in API requests (DEV-2513) (#457) (4cdaf2a)

2.5.0 (2023-07-28)

Enhancements

  • guess subdomains based on conventions (DEV-1979) (#445) (d6c4ff4)

Bug Fixes

  • process-files: quit Python interpreter after every batch to prevent "too many open files" error (DEV-2268) (#402) (1cbf927)
  • start-stack: fix outdated TTL paths, open config file correctly (DEV-2497) (#447) (98e0579)

Maintenance

  • bump start-stack to 2023.07.02 (DEV-2499) #450 (61af5da)
  • deps: bump dependencies (#449) (8fd23d4)
  • increase timeout from 5 to 10 seconds (DEV-2450) #438 (4f82d2e)
  • run dependabot monthly, and group updates into 1 single PR (DEV-2498) #448 (e03d633)
  • xmlupload: forbid empty strings in some tags of the XML, et al. (DEV-2439) (#433) (679654d)

2.4.0 (2023-07-11)

Bug Fixes

  • create: if the name of the ontology is used in a propertyname, it gets removed (DEV-2406) #429 (e6292f0)
  • xmlupload: make sure resources aren't created multiple times after timeout error (DEV-2412) #432 (b109e3c)

Enhancements

  • start-stack: add flag to start stack from main branch of DSP-API repository (DEV-2396) (#424) (6ff2c48)

Maintenance

  • bump start-stack to 2023.07.01 (DEV-2428) (#430) (8e11b95)
  • deps-dev: bump black from 23.3.0 to 23.7.0 (#431) (1aeb778)
  • deps-dev: bump mkdocs-material from 9.1.17 to 9.1.18 (#426) (7a54181)
  • deps: bump jsonschema from 4.17.3 to 4.18.0 (#428) (4b1a9ff)
  • deps: bump lxml from 4.9.2 to 4.9.3 (#427) (1e933b3)
  • deps: bump pandas from 2.0.2 to 2.0.3 (#422) (70b38b0)
  • refactor start-stack (DEV-2397) (#423) (679a267)
  • refine/resolve ignore comments, resolve pylint issues (DEV-2398) (#425) (906c8a3)
  • set up pre-commit hooks (DEV-2393) (#420) (9578181)

2.3.4 (2023-06-27)

Bug Fixes

  • xmlupload: allow colon in URL (DEV-2318) (#419) (b79ab23)

Maintenance

  • bump start-stack to 2023.06.02 (DEV-2312) #418 (88a4bf3)
  • deps-dev: bump mkdocs-material from 9.1.16 to 9.1.17 (#414) (313b923)
  • deps-dev: bump mypy from 1.3.0 to 1.4.0 (#413) (919fd8e)
  • deps-dev: bump mypy from 1.4.0 to 1.4.1 (#415) (2867a00)
  • deps-dev: bump pytest from 7.3.2 to 7.4.0 (#416) (8d6b587)
  • deps-dev: bump types-openpyxl from 3.1.0.12 to 3.1.0.13 (#417) (7b53622)
  • lint "models", part two (DEV-2287) (#406) (466597c)
  • onto create (DEV-2298) #412 (d8abe48)
  • remove dependency inconsistency in pyproject.toml (DEV-2290) #410 (9da9ccf)
  • remove unused code (DEV-2289) (#409) (809f4fe)
  • xmlupload: improve error handling of Timeout Error (DEV-2299) (#411) (b9cf8eb)

2.3.3 (2023-06-13)

Bug Fixes

  • fast xmlupload: make process-files more robust (DEV-2235) (#395) (12d527b)

Maintenance

  • add overview of code quality tools; format code with black (DEV-2224) (#391) (d7fb690)
  • allow latest version of poetry again (DEV-2245) #398 (3d646ad)
  • bump start-stack to 2023.06.01 (DEV-2272) #401 (d684c18)
  • deps-dev: bump pytest from 7.3.1 to 7.3.2 (#403) (6dbcf6c)
  • deps-dev: bump types-openpyxl from 3.1.0.8 to 3.1.0.9 (#405) (12a97d6)
  • deps-dev: bump types-regex from 2023.5.5.0 to 2023.6.3.0 (#397) (067e265)
  • deps: bump docker from 6.1.2 to 6.1.3 (#393) (2a79fe6)
  • deps: bump regex from 2023.5.5 to 2023.6.3 (#396) (6ee38c9)
  • lint "models", part one (DEV-2265) (#400) (27a32b1)
  • loosen python requirement, add py.typed marker (DEV-2278) (#404) (17b22b3)
  • reformat code (DEV-2263) (#399) (35af8c4)

2.3.2 (2023-05-31)

Maintenance

  • bump start-stack to 2023.05.03 (DEV-2222) #392 (80bdecb)
  • deps-dev: bump mkdocs-material from 9.1.14 to 9.1.15 (#390) (18287c3)
  • deps-dev: bump types-requests from 2.30.0.0 to 2.31.0.0 (#382) (74738fa)
  • deps-dev: bump types-requests from 2.31.0.0 to 2.31.0.1 (#389) (1829fd5)
  • deps: bump pandas from 2.0.1 to 2.0.2 (#388) (e23bb10)
  • don't configure logging statically (DEV-2183) (#385) (7c82a59)
  • move _derandomize_xsd_id (DEV-2186) #381 (e909384)
  • refactor CLI part of excel2xml (DEV-2190) (#384) (cd9cbb7)
  • remove autopep8 from dependencies (DEV-2213) #387 (993854b)
  • speed up CI tests with caching (DEV-2165) (#369) (9283aa1)

2.3.1 (2023-05-23)

Bug Fixes

  • process-files: allow files with whitespaces in filename, allow files with uppercase extension (DEV-2182) (#379) (7f63743)

Maintenance

  • code formatting (DEV-2171) (#376) (96a4056)
  • deps-dev: bump mkdocs-material from 9.1.11 to 9.1.14 (#377) (8095f6f)
  • deps-dev: bump types-openpyxl from 3.1.0.7 to 3.1.0.8 (#374) (c536ebc)
  • deps: bump requests from 2.30.0 to 2.31.0 (#378) (b932e03)
  • enable automatic version updating by Dependabot (DEV-2170) #373 (bd1cfd2)
  • lint e2e tests (DEV-2160) (#366) (e75eb27)

2.3.0 (2023-05-17)

Bug Fixes

  • get: write proper tests for get command, fix multiple bugs (DEV-2123) (#356) (edd671d)

Documentation

  • render nested lists correctly, adapt markdownlint rules, apply new rules everywhere (DEV-2134) (#358) (e899d5c)

Enhancements

Maintenance

  • bump dependencies, add docker, update readme, remove unused poetry exec script (DEV-2159) (#365) (69d65e7)
  • bump start-stack to 2023.05.01 (DEV-2164) #368 (646586b)
  • deps: bump pymdown-extensions from 9.11 to 10.0 (#370) (1764e81)
  • excel2xml: minor improvements (DEV-2152) #360 (1d24848)
  • log every CLI call to dsp-tools (DEV-2156) #362 (a93cb86)
  • make all test files executable with pytest (DEV-2157) (1e4d427)
  • prevent access to unset attribute of BaseError (DEV-2158) #364 (b0e089d)
  • resolve CodeQL issues (DEV-2169) #371 (6822344)
  • update mypy, resolve all mypy+pylint issues in "unittests", unignore "unittests" in CI pipline (DEV-2131) (#357) (b75e2c7)
  • XML validation: resource's iri and ark must be unique, resource's label must not be empty (DEV-2154) (#361) (62ec04b)

2.2.2 (2023-05-03)

Bug Fixes

  • xmlupload: print reason of error if a resource cannot be created, remodel BaseError (DEV-1977) (#349) (7f60b1a)

Maintenance

  • bump start-stack to 2023.04.03 (DEV-2117) (#355) (1abb081)
  • resolve linting errors, make linting checks in CI more strict (DEV-2080) (#354) (e3daff3)

2.2.1 (2023-04-18)

Maintenance

  • bump dependencies (DEV-1960) #350 (5b999f5)
  • bump start-stack to 2023.04.02 (DEV-1933) (#351) (163ac19)
  • get: allow shortname to be uppercase (DEV-1972) #346 (e0ce7d4)
  • inside a JSON or Excel file, resource & property names must be unique (DEV-1971) (#345) (c6df889)
  • refactor try_network_action() (DEV-1844) (#325) (896586f)

2.2.0 (2023-03-21)

Bug Fixes

  • allow Pulldown, Radio, and List as gui_elements for lists (DEV-1810) (#330) (5ff1aac)
  • correct broken schema references in test data files (DEV-1832) #323 (512de36)
  • create, get: handle comment to ontology (DEV-1852) #326 (5af3f19)
  • create: allow identical onto names if they belong to different projects (DEV-1777) (#314) (7139f67)
  • create: prevent infinite loop when super-resource is not existing (DEV-1886) (#338) (b176b7c)
  • xmlupload: legitimate html-escapes in utf8-texts don't raise a validation error any more (DEV-1936) (#341) (cf90269)
  • xmlupload: write metrics only when requested to do so (DEV-1883) #334 (5c1196f)

Enhancements

  • check out rosetta and upload it on local stack (DEV-1842) (#332) (d067cc1)
  • create: create a resource class without cardinalities (DEV-1853) #327 (2d1cee0)
  • new command to generate template repo, move schema files (DEV-1839) (#333) (9ea3a4f)

Documentation

  • replace outdated screenshot, use local copy of CSS of dsp-docs (DEV-1896) (#337) (c22c5e4)
  • use single quotes around passwords to prevent problems with special characters (DEV-1825) #320 (ca2bf1a)

Maintenance

  • adapt shortcode of import scripts (DEV-1925) (#340) (f440bda)
  • bump start-stack to 2023.03.02 (DEV-1819) (#317) (54a4514)
  • excel2json: improve error messages of excel2json (DEV-1789) (#315) (36a1209)
  • implement logging system (DEV-132) (#335) (c92e943)
  • merge dublette class into one class (DEV-1831) #322 (e5cddf5)
  • minor improvements (DEV-1912) #336 (91664a9)
  • new error handling strategy (DEV-1770) (#324) (f2aa4b0)
  • remove pystrict dependency (DEV-1843) #329 (2111d21)
  • save location for log files (DEV-1856) (#328) (30f914d)
  • tidy up testdata folder (DEV-1822) (#319) (b5fe9fd)
  • xmlupload: improve user feedback when shortcode or onto are inexistent (DEV-1827) (#321) (f21a64e)

2.1.1 (2023-03-08)

Bug Fixes

  • excel2json: add missing comments in the resources template (DEV-1765) #303 (b2532e4)
  • excel2xml: make_xsd_id_compatible() does now replace all special characters (DEV-1792) (#313) (b87f903)
  • excel2xml: proper handling of special characters in text properties, depending on the encoding (DEV-1719) (#296) (c8f1e7a)
  • get: prevent invalid gui_element "Pulldown" (DEV-1781) #312 (c5d355e)
  • invalid argument names in CLI entrypoint (DEV-1776) #310 (6e1a6fb)

Maintenance

  • allow input of xmlupload to be parsed (DEV-1780) (#311) (abc167f)
  • beautify stack traces (DEV-1766) #305 (17b6f2f)
  • bump start-stack to 2023.03.01 (DEV-1802) (#316) (3d3f476)
  • harmonize CLI help texts with the CLI commands documentation (DEV-1767) (#306) (f9e4dca)
  • new error handling strategy (DEV-1773) (#307) (4c02e18)
  • refactor list creation (DEV-1775) (#309) (78a8488)
  • refactor onto creation (DEV-1774) (#308) (f5a16e4)

2.1.0 (2023-02-21)

Bug Fixes

  • create: improve validation to prevent endless loop if properties are undefined (DEV-1720) (#297) (ee3e446)
  • create: property from other ontology not found (DEV-1381) #299 (d1345ec)

Documentation

  • fix identical heading problem, assimilate mkdocs config to dsp-docs (DEV-1713) (#294) (c235ff3)

Enhancements

  • excel2json: add support for gui_order, make templates better understandable (DEV-1711) (#293) (3b5304f)

Maintenance

  • bump start-stack to 2023.02.02 (DEV-1732) #302 (b97a696)
  • enhanced xmlupload: add test onto (DEV-1760) #300 (ca32842)
  • excel2xml: allow PathLike for bitstream-prop (DEV-1729) #298 (ab9386f)
  • remove temporary workaround in GET groups (DEV-1733) #301 (7ead9de)

2.0.3 (2023-02-07)

Documentation

  • restructure docs, add link-checking (DEV-1623) (#286) (d65ff53)

Maintenance

  • access data files correctly (DEV-1618) (#288) (7a64a27)
  • bump start-stack to 2023.02.01 (DEV-1709) (#292) (5fd58d2)
  • bump versions of start-stack to 2023.01.02 (DEV-1652) (#290) (2889a20)
  • update links according to new structure of docs (DEV-1648) (#289) (16d9c12)

2.0.2 (2023-01-17)

Bug Fixes

  • get command fails if no groups are on the server (DEV-1622) (#283) (d6bf458)

Documentation

  • fix broken links, make dsp-tools uppercase (DEV-1550) (#284) (aa66109)

2.0.1 (2023-01-17)

Maintenance

  • bump versions of start-stack, use dynamic project IRI in get command (DEV-1613) (#282) (2ecf4f5)
  • refactor project creation (DEV-1165) (#280) (5e662a6)
  • use start-stack command for e2e tests, replace Makefile by poetry-exec-plugin (DEV-1597) (#279) (6b85d15)

2.0.0 (2023-01-09)

⚠ BREAKING CHANGES

  • switch to src layout, use poetry, add developer docs (DEV-1523) (#276)

Maintenance

  • adapt schema URLs, adapt title of release-please PR (DEV-1596) (#278) (67f6475)
  • switch to src layout, use poetry, add developer docs (DEV-1523) (#276) (6ae3b4f)

1.22.2 (2022-12-21)

Bug Fixes

  • start-stack: copy docker folder to user's home directory (DEV-1581) (#274) (b0ebfc5)

1.22.1 (2022-12-20)

Bug Fixes

  • start-stack: use TTL files from DSP-API v24.0.8 (DEV-1580) (#273) (3ad96ba)

Documentation

  • improve documentation of DSP permission system (DEV-1561) (#270) (33ab59d)

1.22.0 (2022-12-19)

Bug Fixes

  • excel2xml: better standard permissions (permissions definitions at top of XML file) (DEV-1560) (#268) (b0d30be)
  • xmlupload: improve URL recognition (DEV-1557) (#266) (60f8fe5)
  • xmlupload: prevent crash + improve error message when cardinalities are wrong (DEV-1559) #267 (7bfd82f)

Documentation

  • excel2json: use rosetta as example data (DEV-1478) (#254) (af192cb)
  • readme: explain handling of git submodules (DEV-1502) (#256) (1dc8483)
  • text values: describe which combinations of gui_element and encoding are desirable (DEV-1521) (#259) (21967c6)

Enhancements

  • use docker commands for stack handling (DEV-1530) (#261) (c11edc5)

Maintenance

  • bump versions of GitHub actions (DEV-1532) #263 (efc9f51)
  • fix regex for PR title (DEV-1504) (#257) (d4feb68)
  • start-api: adjust version numbers of DSP-API and DSP-APP according to 2022.11.01 (DEV-1579) #271 (10dcd2f)
  • xmlupload: add metrics flag (DEV-1512) (#264) (f4822dc)
  • xmlupload: handling of upload errors (DEV-1505) (#250) (1507b21)

1.21.0 (2022-11-11)

Bug Fixes

  • bugs in json schema (DEV-1142) (#252) (92af830)
  • excel2xml: prevent writing empty text-prop, make text-prop validation less restrictive (DEV-1440) #243 (ae777e4)

Enhancements

  • add command excel2json to create JSON project file from folder with Excel files (DEV-960) (#248) (e8e05e4)
  • startup API and APP with dsp-tools (DEV-126) (#246) (de182dc)

Documentation

1.20.0 (2022-10-18)

Maintenance

  • xmlupload: improve error message when syntax for referencing ontos is wrong (DEV-1399) (#237) (df0bf33)

Documentation

  • user needs to be project member to become project admin (DEV-1383) (#241) (1a13c02)
  • xmlupload: improve examples, add documentation of geometry-prop JSON format (#240) (7df1d86)

Enhancements

  • xmlupload: enable migration of resource creation date (DEV-1402) (#238) (83dd2de)

1.19.0 (2022-10-07)

Bug Fixes

  • fix command dsp-tools xmlupload --validate (DEV-1360) (#230) (0b2bd40)

Enhancements

  • address feedback to excel2xml: remove param values in all make_*_prop() methods, and fix some bugs (DEV-1361) (#232) (a7e9d85)
  • change input format of excel command: use 1 Excel file for all same-language lists, rename command to excel2lists (DEV-955) (#228) (21cc6bc)

Documentation

Maintenance

  • bump versions (DEV-1117) #235 (fc9c03c)
  • fix release-please (DEV-1396) #234 (3bd92d8)
  • reduce GitHub workflow frequency (DEV-1344) #227 (a0722d8)
  • tests: enforce JKD 17 (DEV-1366) (#231) (1036acd)
  • tidy up excel2lists, excel2resources, excel2properties (DEV-1352) (#229) (d2c2e08)

1.18.0 (2022-09-09)

Enhancements

  • add module csv2xml to convert tabular data to DSP-XML (DEV-134) (#219) (19393aa)

Maintenance

Documentation

  • clarify docs of onto creation (DEV-1164) (#225) (f64d2cf)

1.17.1 (2022-08-22)

Bug Fixes

1.17.0 (2022-08-16)

Bug Fixes

  • catch network interruptions during onto creation (DEV-1073) (#210) (ab0e3b2)

Maintenance

  • stop serving docs to dasch-swiss.github.io (DEV-826) (#211) (f2d25f9)

Documentation

  • add links from usage subpage to other subpages (DEV-812) (#208) (92ac678)
  • fix outdated links (DEV-1194) #215 (6849737)
  • sort entries alphabetically (DEV-1184) (#212) (75c6ae5)

Enhancements

1.16.0 (2022-07-18)

Enhancements

  • xmlupload: implement , , and tags (DEV-855) (#204) (5044a9e)

1.15.1 (2022-06-23)

Bug Fixes

  • excel2resources, excel2properties: cover all cases (DEV-1040) (#201) (4c6ed19)
  • xmlupload crashes without writing id2iri mapping (DEV-813) (#194) (7948e75)

Maintenance

  • unpin dependency versions (DEV-983) (#200) (5c56601)
  • xmlupload: refactor xmlupload, add unittest (DEV-1043) (#203) (fcf8384)

1.15.0 (2022-06-02)

Bug Fixes

  • onto validation: correctly identify circular dependencies (DEV-769) (#192) (ed35902)
  • testdata: remove salsah-links from id2iri/test-id2iri-data.xml (DEV-975) (#199) (7548501)
  • xmlupload: prevent crash with incremental option (DEV-811) (#197) (cccb5e8)

Enhancements

Documentation

  • xmlupload: better explanation of permissions (DEV-969) (#196) (d3efde8)

1.14.0 (2022-05-03)

Enhancements

  • xmlupload: support Baseclass MovingImageRepresentation (#185) (7ebf588)

Documentation

  • fix typos in documentation (DEV-849) (#189) (f887edd)

Maintenance

  • json-schema: change JSON schema version to draft-07 (DEV-848) (#188) (8ca6f87)
  • update lists.json (DEV-851) (#190) (e0254be)
  • update schema-files (DEV-449) (#187) (9a5a50b)

1.13.0 (2022-04-25)

Bug Fixes

  • get: handle slash at end of server, improve docs (DEV-734) (17c0a40)
  • groups: dsp-tools should not allow group creation if group name already in use (DEV-798) (#183) (8f168ca)

Enhancements

  • add support for external ontologies (dev-512) (#170) (ff36bc1)
  • get: get more infos from user (DEV-641) (#181) (407f5c5)

Maintenance

1.12.2 (2022-03-31)

Bug Fixes

  • add missing dependency (DEV-763) (1cda29e)

1.12.1 (2022-03-31)

Maintenance

1.12.0 (2022-03-25)

Bug Fixes

  • onto creation: prevent sorting algorith from modifying original ontology (#169) (9a9e5f0)

Enhancements

  • onto creation: allow that resources and properties are not sorted by inheritance (DEV-626) (#167) (2ebece3)
  • xmlupload: allow circular references (DEV-577) (#165) (75a444f)

1.11.0 (2022-02-28)

Enhancements

  • improve prefix handling in json ontos (DEV-572) (#164) (8610885)

1.10.1 (2022-02-23)

Documentation

  • add explanation how an Excel file for list creation must be structured (DEV-533) (#159) (660d57b)
  • explain the interval-prop more precisely (#162) (00c18dc)

1.10.0 (2022-02-21)

Documentation

Maintenance

  • excel to json list (DEV-431) (#155) (8a8c9d0)
  • xml-upload: print XML validation errors when xmlupload fails due to validation (DEV-387) (#149) (03554c2)

Enhancements

  • improve json schema validation error output (DEV-456) (#153) (9f92b66)
  • make comments optional for new properties and resources (DEV-502) (#158) (9c30746)
  • ontology: add Representation (DEV-551) (#160) (cba7be0)

1.9.0 (2022-01-27)

Documentation

  • add isPartOf and seqnum properties to documentation (DEV-216) (#145) (09d42a4)
  • dsp-tools-excel: mention the GUI order and other small improvements (DEV-99) (#148) (853068d)

Enhancements

  • xmlupload: use custom IRIs created from salsah ARKs for XML upload (DEV-179) (#147) (873324a)

1.8.1 (2022-01-11)

Bug Fixes

  • problem with reference to list values (DEV-356) (#143) (3fce99a)

Maintenance

1.8.0 (2022-01-10)

Bug Fixes

  • ontology: add default values for missing comments (DEV-337) (#141) (6f0094e)
  • print only unresolvable resptrs (#139) (cbe1876)
  • restrict the creation of classes without cardinalities (DEV-305) (#136) (5604a5b)

Enhancements

  • excel-to-json: allow comments in class and property definitions (#111) (807959f)
  • get: extend get command to get more information (DEV-139) (#137) (9ce6722)

Maintenance

  • improve ontology schema and extend tests (DEV-313) (#140) (656ccff)

1.7.1 (2021-12-14)

Bug Fixes

  • groups: make groups optional (DEV-138) (#135) (6aa1aa7)

Maintenance

1.7.0 (2021-12-07)

Bug Fixes

  • boolean-values: allow 0 and 1 as boolean values (DEV-251) (#131) (fd58ad4)
  • create-ontology: within an ontology, references to the ontology itself are not possible (DEV-135) (#130) (6a40fc6)
  • permissions: use permissions in xml upload (DEV-178) (#127) (4dad0ce)

Documentation

  • update out-of-date example in docs (DEV-265) (#125) (0dc724c)

Enhancements

  • update DSP-Tools to support ArchiveRepresentation (DEV-259) (#128) (85a40c2)

1.6.1 (2021-11-25)

Bug Fixes

  • inconsistencies in groups and projects (DEV-261) (#121) (f9a95ed)
  • schema: list root node needs a comments object (DEV-61) (#122) (7bdc589)

1.6.0 (2021-11-22)

Bug Fixes

  • comments: fix comments in ontology creation (DEV-250) (#119) (08effdf)
  • update dsp-tools to work with API version 16.0.0 (#117) (af70e9b)

Documentation

Enhancements

  • id-to-iri: extend xmlupload to allow references to existing resources (DEV-60) (#108) (40b01db)

1.5.2 (2021-11-16)

Maintenance

  • documentation: add missing documentation for excel2resources (DEV-144) (cde0db5)

1.5.1 (2021-10-13)

Bug Fixes

  • schema-documentation: update schemas and documentation (DEV-61) (#105) (4d9c1e4)

1.5.0 (2021-09-24)

Enhancements

  • schema: add error codes for validation (DSP-1902) (#101) (0bc6149)

1.4.2 (2021-09-21)

Bug Fixes

  • docs: fix example in documentation (DSP-1740) (#99) (11cdd72)

1.4.1 (2021-09-20)

Maintenance

  • schemas: update schemas (DSP-1902) (#92) (16ba335)

1.4.0 (2021-09-16)

Documentation

  • typo: correct typo in documentation (#85) (c689d7f)

Enhancements

  • excel-to-properties: create properties from Excel (DSP-1577) (#89) (9f48e9a)
  • excel-to-resources: create resources from excel (DSP-1576) (#88) (7b0302f)

1.3.3 (2021-09-07)

Bug Fixes

1.3.2 (2021-08-17)

Bug Fixes

  • import: fix import error when starting script directly ( DSP-1869) (05b1eb1)

1.3.1 (2021-08-11)

Bug Fixes

  • manifest: fix documentation and missing files ( DSP-1580) (#80) (3345f2a)

1.3.0 (2021-08-10)

Enhancements

  • excel-lists: create multilanguage json lists from excel files ( DSP-1580) (#75) (06d071a)

1.2.1 (2021-07-27)

Bug Fixes

  • release: fix skipped release after pull request #74 ( DSP-1797) (#76) (c8e0a11)

1.2.0 (2021-07-26)

Enhancements

  • verbose xml upload: use v option to print verbose output in XML upload ( DSP-1797) (#70) (b1f56a1)

1.1.6 (2021-07-22)

Documentation

1.1.5 (2021-07-14)

Documentation

  • dsp-tools-xmlupload: Add Warning section (#69) (05baf3d)
  • dsp-tools-xmlupload: addition to incomplete paragraph ( DSP-1693) (#67) (318547f)

1.1.4 (2021-06-16)

Documentation

  • add copyright information to docs ( DSP-1190) (#65) (0174c4a)

1.1.3 (2021-06-08)

Documentation

  • update readme after documentation update ( DSP-1693) (#63) (7b7dcca)

1.1.2 (2021-06-07)

Maintenance

  • bump Bazel to version with M1 support (#60) (69772f4)

Documentation

  • improve documentation ( DSP-1693) (#62) (591b5ad)

1.1.1 (2021-04-20)

Bug Fixes

  • fix import ontology from salsah-export ( DSP-1532) (#59) (6e3e7ca)

Maintenance

1.1.0 (2021-04-09)

Bug Fixes

  • add create_ontology command line configuration (3ab7e6b)
  • add folder independence (2460937)
  • add missing dependencies (4d75128)
  • add user (277121b)
  • bulk-import of multiple resource link values (6ef8908), closes #9
  • cleanup api logging ( DSP-1076) (#46) (d48e704)
  • command line scripts (732a0fa)
  • Correctly set user password (9db6445)
  • Correctly set user password (3583ea2)
  • Do not send logout request if token is not set (9cfd484)
  • removed exception if keywords missing (81f7d97)
  • requirements (b5941f1)
  • typo (3def59d)

Documentation

Enhancements

  • import lists from excel ( DSP-1341) (#48) (3628992)

Maintenance

  • add existing files into new structure (84dc1d2)
  • add publishing setup (c18c6b9)
  • add pypi badge (3fc148c)
  • add runing tests on travis (2eeaeb8)
  • add runing tests on travis (cf4f9e4)
  • add runing tests on travis (b8f3bbc)
  • add runing tests on travis (dc4fa02)
  • add runing tests on travis (16844d8)
  • add runing tests on travis (593ac85)
  • add testing ( ongoing) (c175a16)
  • allow release PRs in PR title check (#54) (0414948)
  • automate release process ( DSP-1492) (#52) (6a96eee)
  • bump version (49bc9d8)
  • bump version (e7364c7)
  • bump version to 1.1.0 ( DSP-1492) (#55) (3814ed2)
  • configure dependencies and command line (7f79530)