[Discussion]: Automatically test the generation of the evaluation spreadsheet

[manics]

Summary

Automatically check that the evaluation spreadsheet contains all statements

Source

Me

Detail

The reference text of the SATRE specification is stored as Markdown tables.

The evaluation spreadsheet is created by parsing the markdown files, extracting the relevant tables, and converting them to a spreadsheet: https://github.com/sa-tre/satre-specification/blob/main/docs/extensions/satrecsv.py

This means it is sensitive to changes in the formatting of the Markdown tables, and to any significant changes in general. Ideally we should have a way to automatically compare the reference Markdown and the spreadsheet.

Intended Output

A way to verify the spreadsheet matches the markdown content.

Who can help

No response