Disable AI tests in CI, only test them on Release #435
Workflow file for this run
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| name: CI | |
| on: | |
| pull_request_review: | |
| types: [submitted] | |
| pull_request: | |
| branches: | |
| - main | |
| workflow_dispatch: | |
| jobs: | |
| Regression: | |
| if: | | |
| ( | |
| (github.event_name == 'pull_request_review' && github.event.review.state == 'approved') || | |
| (github.event_name == 'pull_request' && | |
| (github.event.pull_request.user.login == 'nivcertora' || | |
| github.event.pull_request.user.login == 'liav-certora') | |
| ) | |
| ) && | |
| github.event.pull_request.base.ref == 'main' | |
| env: | |
| ETHSCAN_API_KEY: ${{ secrets.ETHSCAN_API_KEY }} | |
| QUORUM_PATH: "Quorum/tests" | |
| ANTHROPIC_API_KEY: SKIP_TEST_KEY | |
| runs-on: ubuntu-latest | |
| container: | |
| image: public.ecr.aws/certora/cvt-image:2024.10.23-4499-c4f8ad4 | |
| permissions: | |
| id-token: write | |
| contents: read | |
| steps: | |
| - name: Checkout code | |
| uses: actions/checkout@v4 | |
| - name: Install Poetry | |
| run: pip3 install poetry==1.8.5 | |
| - name: Install Quorum Repo | |
| run: poetry install | |
| - name: Lint with Ruff | |
| run: | | |
| poetry run ruff check src | |
| poetry run ruff format --check src | |
| - name: Run unit tests | |
| run: poetry run pytest src/quorum/tests --maxfail=1 --disable-warnings --tb=short | |
| - name: Run Quorum setup | |
| run: poetry run quorum setup --working-dir workdir | |
| - name: Init working directory | |
| run: | | |
| mv src/quorum/tests/regression.json workdir/regression.json | |
| mv src/quorum/tests/ground_truth.json workdir/ground_truth.json | |
| echo "ETHSCAN_API_KEY=${ETHSCAN_API_KEY}" >> workdir/.env | |
| echo "ANTHROPIC_API_KEY=${ANTHROPIC_API_KEY}" >> workdir/.env | |
| - name: Single Address Test | |
| working-directory: workdir | |
| run: poetry run quorum validate-address --protocol-name Aave --chain Ethereum --payload-address 0xAD6c03BF78A3Ee799b86De5aCE32Bb116eD24637 | |
| - name: Batch Test | |
| working-directory: workdir | |
| run: poetry run quorum validate-batch --config regression.json | |
| - name: Proposal ID Test | |
| working-directory: workdir | |
| run: poetry run quorum validate-by-id --proposal-id 137 --protocol-name Aave | |
| - name: IPFS Test | |
| working-directory: workdir | |
| run: poetry run quorum validate-ipfs --proposal-id 20 --chain Scroll --payload-address 0x2B25cb729D90630395Cd3140f3460a73A41Fe5f0 | |
| - name: Generate Report | |
| working-directory: workdir | |
| run: poetry run quorum generate-report --proposal_id 137 |