[NLnet] Domains and service checks #695

Merged

nemunaire merged 28 commits from f/nlnet-core-checkers into master 2026-04-16 09:59:40 +00:00

Conversation 0 Commits 28 Files changed 148 +22176 -184

nemunaire commented 2026-04-05 01:52:10 +00:00

Owner

Copy link

1. Core developments: preparation and scheduling tests

• 1d. Static configuration (or admin API endpoint) to control/enable and configure tests plugins
• 1e. Basic scheduler to queue tests requests
• 1f. API endpoints to list tests, launch a test for a given service, retrieve status, get history and last report

4. Core developments: user interface

• 4b. Form to configure tests from user perspective (relative to its service)
  • configure plugins at user level
  • configure plugins at domain level
  • run tests on demand at domain level
  • configure plugins at service level
  • run tests on demand at service level
• 4c. Page to have domain(s) status overview
• 4d. Pages to display reports through plugins ("standard" metrics or yes-no reports and detailed reports)
  • "standard" metrics or yes-no reports
  • detailed reports (HTML in iframe)

5. Core developments: cron-like and automatic tests

• 5a. Process to schedule tests
• 5b. Interface to configure recurrent tests intervals
• 5c. Admin configuration to restrict/limit automatic tests
• 5d. Documentation

7. Domain tests: zone delegation tests

• 7a. Plugin and container setup for Zonemaster (extends official zonemaster/cli)
  • Run tests
  • Non container needed as Zonemaster expose a usable API
• 7c. half of Frontend integration (dedicated reports)
  • Display formated reports

15. Applications tests: part 0

• 15a. ping plugin (as a sample plugin)
  • Run tests
  • Display metrics reports

16. Applications tests: part 1

• 16d. Matrix IM (as a sample plugin)
  • Run tests
  • Display formated reports

### 1. Core developments: preparation and scheduling tests - [x] 1d. Static configuration (or admin API endpoint) to control/enable and configure tests plugins - [x] 1e. Basic scheduler to queue tests requests - [x] 1f. API endpoints to list tests, launch a test for a given service, retrieve status, get history and last report ### 4. Core developments: user interface - [x] 4b. Form to configure tests from user perspective (relative to its service) - [x] configure plugins at user level - [x] configure plugins at domain level - [x] run tests on demand at domain level - [x] configure plugins at service level - [x] run tests on demand at service level - [x] 4c. Page to have domain(s) status overview - [x] 4d. Pages to display reports through plugins ("standard" metrics or yes-no reports and detailed reports) - [x] "standard" metrics or yes-no reports - [x] detailed reports (HTML in iframe) ### 5. Core developments: cron-like and automatic tests - [x] 5a. Process to schedule tests - [x] 5b. Interface to configure recurrent tests intervals - [x] 5c. Admin configuration to restrict/limit automatic tests - [x] 5d. Documentation ### 7. Domain tests: zone delegation tests - [x] 7a. Plugin and container setup for Zonemaster (extends official zonemaster/cli) - [x] Run tests - Non container needed as Zonemaster expose a usable API - [x] 7c. **half of** Frontend integration (dedicated reports) - [x] Display formated reports ### 15. Applications tests: part 0 - [x] 15a. ping plugin (as a sample plugin) - [x] Run tests - [x] Display metrics reports ### 16. Applications tests: part 1 - [x] 16d. Matrix IM (as a sample plugin) - [x] Run tests - [x] Display formated reports

nemunaire added 10 commits 2026-04-05 01:52:10 +00:00

checkers: add domain model types and checker core registry ... 7e78449d90

Introduce the foundational types for the checker system:
- CheckTarget, CheckPlan, Execution, CheckEvaluation model types
- CheckerDefinition, CheckerOptions, ObservationSnapshot types
- CheckRule, ObservationProvider, CheckAggregator interfaces
- CheckerEngine interface for orchestrating check pipelines
- Global checker and observation provider registries
- WorstStatusAggregator for combining rule results
- New error types, config option for max concurrency, and
  AutoFill constants for context-driven option resolution

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

checkers: add map-based option validation for checker fields ... 32d09e09c2

Add ValidateMapValues() to the forms package for validating
checker option maps against field documentation (required fields,
allowed choices, type checking).

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

checkers: add storage interfaces and implementations ... e6b66e0273

Add the persistence layer for the checker system:
- Storage interfaces (CheckPlanStorage, CheckerOptionsStorage,
  CheckEvaluationStorage, ExecutionStorage, ObservationSnapshotStorage,
  SchedulerStateStorage) in the usecase/checker package
- KV-based implementations for LevelDB/Oracle NoSQL backends
- In-memory implementation for testing
- Integrate checker storage into the main Storage interface

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

checkers: add usecases, engine, and scheduler ... 5b411ec1c5

Implement the checker business logic:
- CheckerOptionsUsecase: scope-based option resolution, validation,
  auto-fill from execution context (domain, zone, service)
- CheckPlanUsecase: CRUD for user scheduling configurations
- CheckStatusUsecase: aggregated status queries, execution history
- CheckerEngine: full execution pipeline (observe, evaluate, aggregate)
- Scheduler: background job executor with auto-discovery, min-heap
  queue, worker pool, and jitter-based scheduling

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

checkers: add API controllers, routes, and app wiring ... 1da766c671

Wire up the checker system to the HTTP layer:
- API controllers for checker operations, options, plans, and results
- Scoped routes at domain and service level
- Admin controllers for checker config and scheduler management
- App initialization: create usecases, start/stop scheduler
- Zone controller updated to include per-service check status

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

checkers: add frontend API client, stores, and utilities ... 9cb9f7b25d

Add the frontend infrastructure for the checker UI:
- API client with scoped helpers for domain/service-level operations
- Svelte stores for checker state (currentExecution, currentCheckInfo)
- Utility functions for status colors, icons, i18n keys, date formatting
- Shared helpers: withInheritedPlaceholders, downloadBlob, collectAllOptionDocs
- English translations for all checker UI strings
- Zone model and form types extended for checker support

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

checkers: add frontend UI components and routes ... a5aa075986

Add all checker UI pages and components:
- Checker list, config, schedule, and rules pages
- Execution list, detail, results, and rules pages
- Sidebar components for domain/service checker status
- Run check modal with option overrides and rule selection
- Domain-scoped and service-scoped check routes
- Admin pages for checker configuration and scheduler management
- Header navigation link for checkers section

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

checkers: add HTML report rendering for observation providers ... b3cf698ee4

Introduce CheckerHTMLReporter interface that observation providers can
implement to render rich HTML documents from their data. The Zonemaster
provider implements it with collapsible accordions and severity badges.

Adds API endpoint GET .../observations/:obsKey/report, frontend stores
for view mode switching (HTML/JSON), and wires the sidebar toggle buttons.

checkers: add metrics export with Prometheus and JSON formats ... 8f2e8c2887

Observation providers can now implement CheckerMetricsReporter to
extract time-series metrics from their stored data. The controller
selects Prometheus text or JSON format based on the Accept header.

Routes: user-level (/api/checkers/metrics), domain-level, per-checker,
and per-execution. Ping exports RTT and packet loss; domain expiry
exports days remaining.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

checkers: add frontend metrics chart on execution pages ... 5af6dba376

Add Chart.js-based line chart for checker metrics. The chart appears
on the executions list page (aggregated) and on individual execution
detail pages. Metrics view mode is selectable via the sidebar alongside
HTML report and raw JSON views.

nemunaire force-pushed f/nlnet-core-checkers from 5af6dba376 to e97f444022 2026-04-05 03:21:25 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from e97f444022 to 39b5af099b 2026-04-05 03:28:40 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 39b5af099b to c6534e607d 2026-04-05 05:01:21 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from c6534e607d to d5372e0a21 2026-04-05 10:11:15 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from d5372e0a21 to f0a0579120 2026-04-05 11:51:24 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from f0a0579120 to 9ce7f5e104 2026-04-05 12:01:35 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 9ce7f5e104 to 5de8a80d5b 2026-04-05 15:11:26 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 5de8a80d5b to 7251ee6053 2026-04-05 16:02:45 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 7251ee6053 to 07c0920293 2026-04-07 19:27:43 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 07c0920293 to eb3c6bea0d 2026-04-07 20:03:49 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from eb3c6bea0d to cc3f7a6a73 2026-04-08 04:06:36 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from cc3f7a6a73 to 3577267b7d 2026-04-08 05:02:35 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 3577267b7d to 690050276b 2026-04-08 05:07:40 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 690050276b to ac38a4fcdc 2026-04-09 10:44:13 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from ac38a4fcdc to 52882bccef 2026-04-10 12:13:58 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 52882bccef to e403db4198 2026-04-10 12:15:55 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from e403db4198 to 15128c034f 2026-04-10 12:20:55 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 15128c034f to 2e0de8cf2c 2026-04-10 12:29:24 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 2e0de8cf2c to b1d7df8d3c 2026-04-10 16:06:44 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from b1d7df8d3c to b416cb5688 2026-04-10 17:30:31 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from b416cb5688 to dbc44fcecb 2026-04-10 17:40:01 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from dbc44fcecb to ea301e169a 2026-04-10 18:56:30 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from ea301e169a to a23461f771 2026-04-10 19:01:30 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from a23461f771 to df722e8201 2026-04-10 19:34:20 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from df722e8201 to 6825f092ab 2026-04-10 19:42:25 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 6825f092ab to b1bb4e9e6c 2026-04-11 05:03:13 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 6825f092ab to 0a95b28178 2026-04-11 08:32:26 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 0a95b28178 to 4758748f90 2026-04-11 09:45:21 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 4758748f90 to 64466a7cce 2026-04-11 10:23:58 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 64466a7cce to 1e3bf0fb33 2026-04-12 08:30:15 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 1e3bf0fb33 to fa0ab902b8 2026-04-14 09:13:04 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 1e3bf0fb33 to 71c14b446c 2026-04-14 10:00:14 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 71c14b446c to 521c169719 2026-04-14 10:04:48 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 521c169719 to a790c4113d 2026-04-14 10:05:47 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from a790c4113d to 1fd8945016 2026-04-14 10:11:40 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 1fd8945016 to 35d2a2f161 2026-04-14 10:47:48 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 35d2a2f161 to 200200f473 2026-04-14 11:17:06 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 200200f473 to c8bb03b2b2 2026-04-14 12:47:29 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from c8bb03b2b2 to 40544d3efb 2026-04-14 14:30:47 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 40544d3efb to 5b4354acb0 2026-04-14 14:35:13 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 5b4354acb0 to bcb47d8d4c 2026-04-15 04:14:39 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from bcb47d8d4c to 544822b57c 2026-04-15 07:49:57 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 544822b57c to 07eb4da7d2 2026-04-15 09:32:05 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 07eb4da7d2 to 40b4bab4a8 2026-04-15 12:41:14 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 40b4bab4a8 to 3c8df24ebc 2026-04-15 18:01:40 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 3c8df24ebc to e5a8c55630 2026-04-15 19:36:13 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from e5a8c55630 to 22aee6a87b 2026-04-15 19:37:51 +00:00 Compare

nemunaire changed title from [WIP] Domains and service checks to Domains and service checks 2026-04-15 19:40:25 +00:00

nemunaire force-pushed f/nlnet-core-checkers from 22aee6a87b to 5e988b4098 2026-04-15 20:18:42 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 5e988b4098 to 6e91c779bd 2026-04-15 21:47:47 +00:00 Compare

nemunaire force-pushed f/nlnet-core-checkers from 6e91c779bd to e0dc19614f 2026-04-16 09:58:32 +00:00 Compare

nemunaire changed title from Domains and service checks to [NLnet] Domains and service checks 2026-04-16 09:58:45 +00:00

nemunaire merged commit e0dc19614f into master 2026-04-16 09:59:40 +00:00

nemunaire deleted branch f/nlnet-core-checkers 2026-04-16 09:59:41 +00:00

Sign in to join this conversation.

Reviewers

No reviewers

Labels

Clear labels

No items

No labels

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

happyDomain/happyDomain!695

No description provided.