How to manage collect CSV Files

This page explains how to gather and process events from CSV files for analysis or forwarding.

Navigate to Settings

Log in to the CYBERQUEST web interface with an account with administrative rights.

Navigate to "Settings > Management > Data Source Manager".

This page contains all the data sources added in the CYBERQUEST application.

Complete the form

Press the "ADD DATA-SOURCE" button and complete the following form:

DataSource Type: Select Applications / Generic CSV files as the data source type.

DataSource Information: Automatically populated with details about the selected data source.

Query Interval: Defines how often the folder is scanned for new or updated files. The default interval is 60 seconds.

Credentials to use: Select credentials if accessing a network share (leave empty for local paths)

Tag: Automatically filled in with a default identifier, which can be customized if needed.

Administrative Notes: Optional field for adding notes or details about the data source.

Anonymize Fields: Select specific fields to anonymize, if required, for data privacy.

Monitored folder: The monitored folder is the specified file path that the system continuously observes for changes.

File Mask: Specify the file pattern to include.

File Buffer Size: Define the buffer size (in bytes) used when reading files.

File Quote: Specify the quote character used in the CSV file (e.g., ")

File Delimiter: Field delimiter.

File Escape Char: Set the field separator character.

File Comment Starts With: Comment prefix to ignore lines (optional).

File Has Headers: Indicates the first row contains column headers.

File Encoding: Character encoding.

File Date Time Format: Combined date/time format if a single column contains both.

File Date Time Column: Column index or name containing combined date/time.

File Time Column: Column index or name for time (if separate).

File Time Format: Time format.

File Date Column: Column index or name for date (if separate)

File Date Format: Date format.

Field Mapper: Map CSV columns to CYBERQUEST fields. Add custom fields with the New button:

Click the "Save" button to save the data source.

Assign the CYBERQUEST agent

The next step is to assign the CYBERQUEST agent to this data source. Choose the agent that has access to the monitored folder.

Actions menu

To edit the data source, click Edit . This process is almost identical to adding a data source.

Bulk Clone : Clone the current data source settings for each value in the "Bulk Clone" field.

Clone : Clone the data source.

Delete: remove the data source from the list.