If I had to explain my job... #IOER_FDz .. I'd just show this workflow from the last two days. It's a great example of building reproducible, automated documentation. 🚀

1. Start: A project schema, drafted by colleagues in Excel.

2. Problem: Excel isn't reproducible and is hard to use as a single source of truth for a database.
Solution: I migrated the schema to the universal Protobuf format, making it version-controlled and language-neutral. [1]

3. Problem: Protobuf definitions aren't easy for everyone to read.
Solution: Using an existing #CI/#CD workflow from [3] (cheers @mcnesium), I put the schema on a documentation website. Now it's accessible and legible. [4]

4. Problem: Colleagues still needed a familiar template for data collection.
Solution: Two Python scripts using #pandas now auto-generates both `.xlsx` and open-source `.ods` schema [5] and templates [6] directly from the Protobuf single-point-of-truth, and make all of these available for download, too.

5. Problem: The text-based schema wasn't visual enough.
Solution: Added a script [7] to the CI that transforms the Protobuf files into a #MermaidJS class diagram, rendered directly on the docs site. [8]

6. Problem: The diagram was too narrow in the site's layout.
Solution: The script now generates a second, wide-format version of the diagram for a dedicated fullscreen view. [9]

7. Problem: The static diagram was hard to edit or restyle.
Solution: The CI now generates a shareable link to the Mermaid Live Editor [10]. It reads our latest diagram file, compresses it (using pako/zlib), and bakes it into the URL. Thanks to a code snippet from a friendly stranger on GitHub [11], anyone can now open the *latest* version of the schema in the editor with a single click.

From a static Excel file to version-controlled, multi-format, visual, and interactive documentation, all fully automated. That's the job.

#Automation #GitLab #Python #Protobuf #OpenData #Documentation

@ioer

[1]: https://gitlab.vgiscience.de/casereports/rwlschema
[2]: https://docs.casereports.fdz.ioer.info/
[3]: https://lbsn.vgiscience.org
[4]: https://docs.casereports.fdz.ioer.info/protobuf/
[5]: https://gitlab.vgiscience.de/casereports/rwlschema/-/blob/main/resources/generate_schema.py?ref_type=heads
[6]: https://gitlab.vgiscience.de/casereports/rwlschema/-/blob/main/resources/generate_template.py?ref_type=heads
[7]: https://gitlab.vgiscience.de/casereports/rwlschema/-/blob/main/resources/generate_proto_uml.sh?ref_type=heads
[8]: https://docs.casereports.fdz.ioer.info/konzept/
[9]: https://docs.casereports.fdz.ioer.info/uml/fullscreen.html
[10]: https://mermaidlive.com/play
[11]: https://github.com/mermaid-js/mermaid-live-editor/discussions/1291#discussioncomment-6837936

💡 Neue Trainingsmaterialien des #IOER_FDz zeigen, wie transparente & reproduzierbare Forschung geht! Anhand von NFDI-Biodiversitäts- & IOER-Flächendaten lehren wir den gesamten Workflow von der API-Abfrage, über räumliche Verarbeitung in Python & Jupyter bis zur Daten-Publikation mit #ioerDATA 👉 https://www.ioer.de/presse/aktuelles/ioer-fdz-veroeffentlicht-trainingsmaterial

#openscience #FAIRdata

@a_tack @leibnizopenscience @konsortswd
@ratswd
@alex
@NFDI @BERD_NFDI @nfdi4earth

At the #IOER_FDZ, we have been thinking about ways to improve the production of scientific knowledge and contribute solutions to the #reproducibility crisis.

One initiative that we are now sharing with the wider scientific community is #Carto-Lab Docker, a computational environment for the #spatial sciences built on a versioned, reproducible Docker container stack that enables FAIR principles (findable, accessible, interoperable and reusable). @mcnesium and I started developing it seven years ago. Having moved to version v.1.0.0, the software now left its beta phase and became an official research infrastructure component of the IOER-FDZ. (🚀@ Marc!)

It includes pre-configured, environments for #open-source #cartography in #Python and #R, and has been designed to support transparent geospatial data analysis and sound publication practices in science.

Firstly, Carto-Lab Docker bundles existing open-source software together with #Jupyterlab for easy deployment and use, reducing the barriers to good scientific practice and efficiently working in teams. It also encompasses critical training materials, documentation, and best-practice code to facilitate collaborative learning and incremental progress in research.

You can find the documentation at [1]. Users may also be interested in our NFDI4Biodiversity training materials [2], which were authored using Carto-Lab Docker and explain many of the underlying concepts. Developers and administrators can find our public container images in the Quay.io container registry [3]. Contributions and input are warmly welcomed on Github [4].

@ioer

[1]: https://cartolab.fdz.ioer.info/
[2]: https://training.fdz.ioer.info/
[3]: https://quay.io/repository/ioer-fdz/carto-lab-docker?tab=info
[4]: https://github.com/ioer-dresden/carto-lab-docker

✨ #ioerDATA: Über 1.000 Downloads ✨
Erst seit Kurzem ist das zu unserem #IOER_FDZ gehörige Repositorium für #Forschungsdaten – das #ioerDATA – online. Seitdem wurden die dort zur Verfügung gestellten Datensätze und Dokumentationen – wie zum Beispiel zur 🌐 Flächennutzung (#IOERMonitor) oder zu🌳 #Stadtgrün – über 1.000 Mal heruntergeladen.

Schaut vorbei:
👉 direkt zum ioerDATA (Link: https://data.fdz.ioer.de/)
👉 zur Webseite des IÖR-FDZ (Link: https://ioer-fdz.de/)

@ratswd @vdv @a_tack

🚨 IÖR startet Forschungsdaten-Repositorium #ioerDATA.

Hochauflösende und gut dokumentierte Daten zu 🌐 Flächenverbrauch, 🌳 Stadtgrün, 🏨 Bauwerksbestand etc., kostenfrei und FAIR. Kuratiert und verwaltet durch das #IOER_FDZ. Mehr Infos 👉 https://www.ioer.de/presse/aktuelles/repositorium-ioer-data-gestartet

@smc_germany @a_tack @BKG @BMWSB_Bund @NFDI

#GeoData #SpatialData #ioerDATA #IOER_FDZ #Landuse #Flächenverbauch #Geoinformatics #Flächennutzung #Raumentwicklung #SustainabilityTransition

📅 Ihr wollt lernen, wie ihr Daten für eine nachhaltige Stadtgestaltung nutzbar machen könnt?

Dann schaut vorbei am 17.04. beim Urban Data Summit auf der Data Week Leipzig.

Wir sind mit der #IOER_FDZ vor Ort

👉 https://www.dksr.city/news-2/veranstaltungen/urban-data-summit-2024/

@DataWeekLeipzig @NFDI @BERD_NFDI @nfdi4earth @konsortswd

Interessiert, neue Analyse- und Modellierungsansätze im Themenfeld #Zirkularität und #Resilienz der gebauten Umwelt zu erarbeiten? Dann bis 23. Juni als Senior Data Scientist (w/m/d) bewerben. #Stellenangebot #IOER_FDZ