Familiarize yourself with the OCSF schema before writing queries.
Quick Start
To run an advanced query, navigate to the Events page and select the icon in the top right.Schema
Theevents
table is the largest and most verbose table in our SIEM. Large or unbounded queries to this table will likely timeout or hit resource limits. It is suggested to always include a time filter when querying this or any other table.
We stringify a majority of the JSON fields in the OCSF schema to optimize for storage and query performance. You will see this with fields like src_endpoint
. To query these fields you will want to use utility fields from Clickhouse like JSONExtractString(src_endpoint, 'ip')
to extract their unique fields. Utilize the OCSF schema docs for understanding what fields are available on those objects.
Tables
events
- All OCSF eventsauthentication_events
- All events with a class name of “Authentication”
authentication_events
table, since it will not require filtering all of your global events. All columns present in the events
table are present in the respective class event tables as well.
Views
These views precompute data on a recurring basis (typically daily) and expose statistics about behavior in your environment.Email-based views
authentication_email_asn
- Tracks login patterns by ASN per userauthentication_email_location
- Identifies common login locations per userauthentication_email_ip
- Detects common IP access patterns per userauthentication_email_user_agent
- Detects common browser/device usage per userauthentication_email_hour_of_day
- Detects common login time patterns per userauthentication_email_vpn
- Detects common VPN usage per user
Team-based views
authentication_team_asn
- Tracks network provider usage across the organizationauthentication_team_location
- Identifies organizational access patterns globallyauthentication_team_ip
- Detects suspicious IP sources across the organizationauthentication_team_user_agent
- Tracks browser/device usage across the organizationauthentication_team_hour_of_day
- Analyzes common hours of activity across the organizationauthentication_team_vpn
- Analyzes common VPN usage across the organization
Null values
Storing null values in Clickhouse can be considered an anti-pattern. Instead, identifiable default values are used. For strings this would be the empty string""
. For Int64 columns this would be -12341234
.
Timestamps
All timestamps are stored and presented in UTC.Resource limits
- 2000 rows per query (100 for custom detections)
- 4GB of memory per query
- 60s of execution time per query