com.unraveldata.job.collector.running.load.conf

When set to true

com.unraveldata.job.collector.hive.queries.cache.size

This is used to improve the Hive-MR pipeline by caching data so it can be retrieved from cache instead of external API. You should not have to change this value.

com.unraveldata.max.attempt.log.dir.size.in.bytes

Maximum size of the aggregated executor log that are imported and processed by the Spark worker for a successful application.

com.unraveldata.max.failed.attempt.log.dir.size.in.bytes

Maximum size of the aggregated executor log that are imported and processed by the Spark worker for a failed application.

com.unraveldata.min.job.duration.for.attempt.log

Minimum duration of a successful application or which executor logs are processed (in milliseconds).

com.unraveldata.min.failed.job.duration.for.attempt.log

Minimum duration of failed/killed application for which executor logs are processed (in milliseconds).

com.unraveldata.attempt.log.max.containers

Maximum number of containers for the application. If application has more than configured number of containers then the aggregated executor log is processed for the application.

com.unraveldata.spark.master

Default master for spark applications. (Used to download executor log using correct APIs.) Valid Options: yarn, mesos, standalone.

com.unraveldata.process.executor.log

Set the flag to process the executor logs.

true: The executor logs are processed.

false: the executor logs are not processed even using Load Logs.