Skip to content

Plot generation script

Valentin Kuznetsov edited this page Sep 27, 2017 · 3 revisions

Plots can be generated using data_aggregation_plots.py script.

Script requires one parameter - input csv filename. Example:

python data_aggregation_plots.py --input_filename FileWithData.csv

CSV file for input can be generated using download_and_concat.sh script. Download and concat script must be run in analytix environment as it downloads files from hadoop filesystem. It expects files to be in separate folders for each day, for example /cms/users/jrumsevi/agg/2017/09/15. User must provide path in hadoop file system. From and To dates are optional.

Script usage example (dates 09-01 to 09-15):

# specify path on HDFS
./download_and_concat.sh /cms/users/vk/agg 20170901 20170915
Clone this wiki locally