Android_Workloads


Android Multiple Workloads - complex example

This complex example shows multiple workloads being executed in multiple configurations.

Please check the notebooks in examples/android/benchmarks/ and examples/android/workloads/ to get more details on each of the possible workloads and how you can visualise their results.


In [1]:
import logging
from conf import LisaLogging
LisaLogging.setup()


2017-03-14 11:05:03,363 INFO    : root         : Using LISA logging configuration:
2017-03-14 11:05:03,364 INFO    : root         :   /home/vagrant/lisa/logging.conf

In [2]:
%pylab inline

import collections
import copy
import json
import os
from time import sleep

# Support to access the remote target
import devlib
from env import TestEnv

# Import support for Android devices
from android import Screen, Workload, System

# Support for trace events analysis
from trace import Trace

# Suport for FTrace events parsing and visualization
import trappy

import datetime


Populating the interactive namespace from numpy and matplotlib

Support Functions


In [3]:
def set_performance():
    target.cpufreq.set_all_governors('performance')

def set_powersave():
    target.cpufreq.set_all_governors('powersave')

def set_interactive():
    target.cpufreq.set_all_governors('interactive')

def set_sched():
    target.cpufreq.set_all_governors('sched')

def set_ondemand():
    target.cpufreq.set_all_governors('ondemand')
    
    for cpu in target.list_online_cpus():
        tunables = target.cpufreq.get_governor_tunables(cpu)
        target.cpufreq.set_governor_tunables(
            cpu,
            'ondemand',
            **{'sampling_rate' : tunables['sampling_rate_min']}
        )

In [4]:
def experiment(wl, res_dir, conf_name, wload_name, collect=''):
    
    ##################################
    # Initial setup

    # Load workload params
    wload_kind = wload_name.split()[0]
    iterations = int(wload_name.split()[1])
    wload_tag = wload_name.split()[2]\
                .replace('https://youtu.be/', '')\
                .replace('?t=', '_')
            
    # Check for workload being available
    wload = Workload.getInstance(te, wload_kind)
    if not wload:
        return {}
    
    # Setup test results folder
    exp_dir = os.path.join(res_dir, conf_name, "{}_{}".format(wload_kind, wload_tag))
    os.system('mkdir -p {}'.format(exp_dir));

    # Configure governor
    confs[conf_name]['set']()    
    
    ###########################
    # Run the required workload
    
    # Jankbench
    if 'Jankbench' in wload_name:
        wload.run(exp_dir, wload_tag, iterations, collect)

    # UiBench
    elif 'UiBench' in wload_name:
        test_name = wload_name.split()[2]
        duration_s = int(wload_name.split()[3])
        wload.run(exp_dir, test_name, duration_s, collect)

    # YouTube
    elif 'YouTube' in wload_name:
        video_url = wload_name.split()[2]
        video_duration_s = int(wload_name.split()[3])
        wload.run(exp_dir, video_url, video_duration_s, collect)

    # RTApp based workloads
    elif 'RTApp' in wload_name:
        rtapp_kind = wload_name.replace('RTApp ', '')
        rtapp_run(rtapp_kind)
        
    # Dump platform descriptor
    te.platform_dump(exp_dir)

In [5]:
def run_experiments(test_confs, wloads, confs, verbose=False):

    # Make sure we have a list of configuraitons to test
    if not isinstance(test_confs, list):
        test_confs = [test_confs]

    # Intialize Workloads for this test environment
    wl = Workload(te)

    # Change to info once the notebook runs ok
    if verbose:
        LisaLogging.setup(level=logging.DEBUG)
    else:
        LisaLogging.setup(level=logging.INFO)

    # Run the benchmark in all the configured configurations
    for conf_name in test_confs:

        # Setup data to be collected
        try:
            collect = confs[conf_name]['collect']
            logging.info("Enabling collection of: %s", collect)
        except:
            collect = ''

        # Enable energy collection only if an emeter has been configured
        if 'energy' in collect:
            if 'emeter' not in my_conf or not te.emeter:
                logging.warning('Disabling ENERGY collection')
                logging.info('EMeter not configured or not available')
                collect = collect.replace('energy', '')
            else:
                logging.debug('Enabling ENERGY collection')

        # Run each workload
        idx = 0
        for wload_name in wloads:
            
            # Skip workload if not enabled by the configuration
            try:
                enabled = False
                enabled_workloads = confs[conf_name]['wloads']
                for wload in enabled_workloads:
                    if wload in wload_name:
                        enabled = True
                        break
                if not enabled:
                    logging.debug('Workload [%s] disabled',
                                 wload_name)
                    continue
            except:
                # No workload filters defined, execute all workloads
                logging.debug('All workloads enabled')
                pass

            # Log test being executed
            idx = idx + 1
            wload_kind = wload_name.split()[0]
            logging.info('------------------------')
            logging.info('Test %d: %s in %s configuration',
                         idx, wload_kind.upper(), conf_name.upper())
            logging.info('        %s', wload_name)
            
            experiment(wl, te.res_dir, conf_name, wload_name, collect)

Test environment setup

For more details on this please check out examples/utils/testenv_example.ipynb.

devlib requires the ANDROID_HOME environment variable configured to point to your local installation of the Android SDK. If you have not this variable configured in the shell used to start the notebook server, you need to run a cell to define where your Android SDK is installed or specify the ANDROID_HOME in your target configuration.

In case more than one Android device are conencted to the host, you must specify the ID of the device you want to target in my_target_conf. Run adb devices on your host to get the ID.


In [6]:
# Setup target configuration
my_conf = {

    # Target platform and board
    "platform"      : 'android',
    "device"        : "FA6A10306347",
    "ANDROID_HOME"  : '/home/vagrant/lisa/tools/android-sdk-linux/',

    # Folder where all the results will be collected
    "results_dir" : "Android_Multiple_Workloads",

    # Define devlib modules to load
    "modules"     : [
        'cpufreq'       # enable CPUFreq support
    ],

    # FTrace events to collect for all the tests configuration which have
    # the "ftrace" flag enabled
    "ftrace"  : {
         "events" : [
            "sched_switch",
            "sched_overutilized",
            "sched_contrib_scale_f",
            "sched_load_avg_cpu",
            "sched_load_avg_task",
            "sched_tune_tasks_update",
            "sched_boost_cpu",
            "sched_boost_task",
            "sched_energy_diff",
            "cpu_frequency",
            "cpu_idle",
            "cpu_capacity",
         ],
         "buffsize" : 10 * 1024,
    },

    # Tools required by the experiments
    "tools"   : [ 'trace-cmd' ],
}

In [7]:
# List of possible workloads to run, each workload consists of a workload name
# followed by a list of workload specific parameters
test_wloads = [
# YouTube workload:
# Params:
# - iterations: number of read/write operations to execute
# - URL:        link to the video to use (with optional start time)
# - duration:   playback time in [s]
    'YouTube 1 https://youtu.be/XSGBVzeBUbk?t=45s   60',

# Jankbench workload:
# Params:
# - iterations: number of read/write operations to execute
# - id:         benchmakr to run
    'Jankbench 1 list_view',
    'Jankbench 1 image_list_view',
    'Jankbench 1 shadow_grid',
    'Jankbench 1 low_hitrate_text',
    'Jankbench 1 high_hitrate_text',
    'Jankbench 1 edit_text',
    
    # Multi iterations
    'Jankbench 3 list_view',
    'Jankbench 3 image_list_view',
    'Jankbench 3 shadow_grid',
    'Jankbench 3 low_hitrate_text',
    'Jankbench 3 high_hitrate_text',
    'Jankbench 3 edit_text',

# UiBench workload:
# Params:
# - test_name:  The name of the test to start
# - duration:   playback time in [s]
    'UiBench 1 TrivialAnimationActivity 10',

# RT-App workload:
# Params:
# - configration: tasks configuration to run
# - [configuration specific parameters]
    'RTApp STAccount 6',
    'RTApp RAMP',
]

In [8]:
# Available test configurations
# 'set' : a setup function to be called before starting the test
# 'collect' defines what we want to collect as a list of strings.
#     Supported values are
#        energy   - Use the my_conf's defined emeter to measure energy consumption across experiments
#        ftrace   - Collect an execution trace using trace-cmd
#        systrace - Collect an execution trace using Systrace/Atrace
#     NOTE: energy is automatically enabled in case an "emeter" configuration is defined in my_conf

confs = {
     'j_std' : {
         'set'     : set_interactive,
         'wloads'  : ['Jankbench 1 list_view'],
         'collect' : 'ftrace',
     },
     'j_eas' : {
        'set'      :  set_sched,
        'wloads'   : ['Jankbench 1 list_view'],
        'collect'  : 'ftrace',
     },
     'y_std' : {
         'set'     : set_interactive,
         'wloads'  : ['YouTube 1 https://youtu.be/XSGBVzeBUbk?t=45s'],
         'collect' : 'ftrace',
     },
     'u_eas' : {
        'set'      :  set_sched,
        'wloads'   : ['UiBench 1 TrivialAnimationActivity'],
        'collect'  : 'systrace',
     }
}

In [9]:
# List of experiments to run
experiments = ['j_std', 'j_eas', 'y_std', 'u_eas']

In [10]:
# Initialize a test environment using:
te = TestEnv(my_conf, wipe=False)
target = te.target


2017-03-14 11:05:12,767 INFO    : TestEnv      : Using base path: /home/vagrant/lisa
2017-03-14 11:05:12,767 INFO    : TestEnv      : Loading custom (inline) target configuration
2017-03-14 11:05:12,768 INFO    : TestEnv      : External tools using:
2017-03-14 11:05:12,769 INFO    : TestEnv      :    ANDROID_HOME: /home/vagrant/lisa/tools/android-sdk-linux/
2017-03-14 11:05:12,769 INFO    : TestEnv      :    CATAPULT_HOME: /home/vagrant/lisa/tools/catapult
2017-03-14 11:05:12,770 INFO    : TestEnv      : Devlib modules to load: ['cpufreq']
2017-03-14 11:05:12,770 INFO    : TestEnv      : Connecting Android target [FA6A10306347]
2017-03-14 11:05:12,770 INFO    : TestEnv      : Connection settings:
2017-03-14 11:05:12,771 INFO    : TestEnv      :    {'device': 'FA6A10306347'}
2017-03-14 11:05:12,914 INFO    : android      : ls command is set to ls -1
2017-03-14 11:05:13,430 INFO    : TestEnv      : Initializing target workdir:
2017-03-14 11:05:13,431 INFO    : TestEnv      :    /data/local/tmp/devlib-target
2017-03-14 11:05:14,701 INFO    : TestEnv      : Topology:
2017-03-14 11:05:14,702 INFO    : TestEnv      :    [[0, 1], [2, 3]]
2017-03-14 11:05:15,291 INFO    : TestEnv      : Enabled tracepoints:
2017-03-14 11:05:15,292 INFO    : TestEnv      :    sched_switch
2017-03-14 11:05:15,292 INFO    : TestEnv      :    sched_overutilized
2017-03-14 11:05:15,293 INFO    : TestEnv      :    sched_contrib_scale_f
2017-03-14 11:05:15,293 INFO    : TestEnv      :    sched_load_avg_cpu
2017-03-14 11:05:15,294 INFO    : TestEnv      :    sched_load_avg_task
2017-03-14 11:05:15,294 INFO    : TestEnv      :    sched_tune_tasks_update
2017-03-14 11:05:15,295 INFO    : TestEnv      :    sched_boost_cpu
2017-03-14 11:05:15,295 INFO    : TestEnv      :    sched_boost_task
2017-03-14 11:05:15,295 INFO    : TestEnv      :    sched_energy_diff
2017-03-14 11:05:15,296 INFO    : TestEnv      :    cpu_frequency
2017-03-14 11:05:15,296 INFO    : TestEnv      :    cpu_idle
2017-03-14 11:05:15,297 INFO    : TestEnv      :    cpu_capacity
2017-03-14 11:05:15,297 INFO    : TestEnv      : Set results folder to:
2017-03-14 11:05:15,298 INFO    : TestEnv      :    /home/vagrant/lisa/results/Android_Multiple_Workloads
2017-03-14 11:05:15,298 INFO    : TestEnv      : Experiment results available also in:
2017-03-14 11:05:15,299 INFO    : TestEnv      :    /home/vagrant/lisa/results_latest

Workloads Execution and Data Collection


In [11]:
run_experiments(experiments, test_wloads, confs, True)


2017-03-14 11:05:17,641 INFO    : root         : Using LISA logging configuration:
2017-03-14 11:05:17,642 INFO    : root         :   /home/vagrant/lisa/logging.conf
2017-03-14 11:05:17,642 INFO    : root         : Enabling collection of: ftrace
2017-03-14 11:05:17,643 DEBUG   : root         : Workload [YouTube 1 https://youtu.be/XSGBVzeBUbk?t=45s   60] disabled
2017-03-14 11:05:17,643 INFO    : root         : ------------------------
2017-03-14 11:05:17,644 INFO    : root         : Test 1: JANKBENCH in J_STD configuration
2017-03-14 11:05:17,645 INFO    : root         :         Jankbench 1 list_view
2017-03-14 11:05:18,248 INFO    : Workload     : Supported workloads available on target:
2017-03-14 11:05:18,249 INFO    : Workload     :   jankbench, youtube, geekbench, uibench, gmaps, vellamo
2017-03-14 11:05:18,250 DEBUG   : Jankbench    : Workload created
2017-03-14 11:05:22,760 INFO    : Screen       : Set brightness: 0%
2017-03-14 11:05:22,761 INFO    : Screen       : Force manual orientation
2017-03-14 11:05:22,763 INFO    : Screen       : Set orientation: PORTRAIT
2017-03-14 11:05:23,610 DEBUG   : Jankbench    : Start Jank Benchmark [0:list_view]
2017-03-14 11:05:23,610 INFO    : Jankbench    : am start -n "com.android.benchmark/.app.RunLocalBenchmarksActivity" --eia "com.android.benchmark.EXTRA_ENABLED_BENCHMARK_IDS" 0 --ei "com.android.benchmark.EXTRA_RUN_COUNT" 1
2017-03-14 11:05:23,992 INFO    : Jankbench    : adb -s FA6A10306347 logcat ActivityManager:* System.out:I *:S BENCH:*
2017-03-14 11:05:23,994 DEBUG   : Jankbench    : Iterations:
2017-03-14 11:05:24,047 INFO    : Jankbench    : FTrace START
2017-03-14 11:05:25,177 DEBUG   : Jankbench    : Benchmark started!
2017-03-14 11:05:25,178 DEBUG   : Jankbench    : Iteration  1:
2017-03-14 11:05:58,847 INFO    : Jankbench    :    Mean:  27.681 JankP:   0.061 StdDev:  23.413 Count Bad:    3 Count Jank:    1
2017-03-14 11:05:59,890 DEBUG   : Jankbench    : Benchmark done!
2017-03-14 11:06:00,002 INFO    : Jankbench    : FTrace STOP
2017-03-14 11:06:04,833 INFO    : Screen       : Set orientation: AUTO
2017-03-14 11:06:06,981 INFO    : Screen       : Set brightness: AUTO
2017-03-14 11:06:06,982 DEBUG   : root         : Workload [Jankbench 1 image_list_view] disabled
2017-03-14 11:06:06,983 DEBUG   : root         : Workload [Jankbench 1 shadow_grid] disabled
2017-03-14 11:06:06,983 DEBUG   : root         : Workload [Jankbench 1 low_hitrate_text] disabled
2017-03-14 11:06:06,984 DEBUG   : root         : Workload [Jankbench 1 high_hitrate_text] disabled
2017-03-14 11:06:06,984 DEBUG   : root         : Workload [Jankbench 1 edit_text] disabled
2017-03-14 11:06:06,984 DEBUG   : root         : Workload [Jankbench 3 list_view] disabled
2017-03-14 11:06:06,985 DEBUG   : root         : Workload [Jankbench 3 image_list_view] disabled
2017-03-14 11:06:06,985 DEBUG   : root         : Workload [Jankbench 3 shadow_grid] disabled
2017-03-14 11:06:06,986 DEBUG   : root         : Workload [Jankbench 3 low_hitrate_text] disabled
2017-03-14 11:06:06,986 DEBUG   : root         : Workload [Jankbench 3 high_hitrate_text] disabled
2017-03-14 11:06:06,987 DEBUG   : root         : Workload [Jankbench 3 edit_text] disabled
2017-03-14 11:06:06,987 DEBUG   : root         : Workload [UiBench 1 TrivialAnimationActivity 10] disabled
2017-03-14 11:06:06,987 DEBUG   : root         : Workload [RTApp STAccount 6] disabled
2017-03-14 11:06:06,988 DEBUG   : root         : Workload [RTApp RAMP] disabled
2017-03-14 11:06:06,988 INFO    : root         : Enabling collection of: ftrace
2017-03-14 11:06:06,989 DEBUG   : root         : Workload [YouTube 1 https://youtu.be/XSGBVzeBUbk?t=45s   60] disabled
2017-03-14 11:06:06,989 INFO    : root         : ------------------------
2017-03-14 11:06:06,989 INFO    : root         : Test 1: JANKBENCH in J_EAS configuration
2017-03-14 11:06:06,990 INFO    : root         :         Jankbench 1 list_view
2017-03-14 11:06:06,990 DEBUG   : Jankbench    : Workload created
2017-03-14 11:06:10,964 INFO    : Screen       : Set brightness: 0%
2017-03-14 11:06:10,966 INFO    : Screen       : Force manual orientation
2017-03-14 11:06:10,966 INFO    : Screen       : Set orientation: PORTRAIT
2017-03-14 11:06:11,776 DEBUG   : Jankbench    : Start Jank Benchmark [0:list_view]
2017-03-14 11:06:11,777 INFO    : Jankbench    : am start -n "com.android.benchmark/.app.RunLocalBenchmarksActivity" --eia "com.android.benchmark.EXTRA_ENABLED_BENCHMARK_IDS" 0 --ei "com.android.benchmark.EXTRA_RUN_COUNT" 1
2017-03-14 11:06:12,241 INFO    : Jankbench    : adb -s FA6A10306347 logcat ActivityManager:* System.out:I *:S BENCH:*
2017-03-14 11:06:12,242 DEBUG   : Jankbench    : Iterations:
2017-03-14 11:06:12,305 INFO    : Jankbench    : FTrace START
2017-03-14 11:06:13,552 DEBUG   : Jankbench    : Benchmark started!
2017-03-14 11:06:13,553 DEBUG   : Jankbench    : Iteration  1:
2017-03-14 11:06:47,377 INFO    : Jankbench    :    Mean:  38.852 JankP:   0.061 StdDev:  40.832 Count Bad:    3 Count Jank:    1
2017-03-14 11:06:48,464 DEBUG   : Jankbench    : Benchmark done!
2017-03-14 11:06:48,645 INFO    : Jankbench    : FTrace STOP
2017-03-14 11:06:54,096 INFO    : Screen       : Set orientation: AUTO
2017-03-14 11:06:57,305 INFO    : Screen       : Set brightness: AUTO
2017-03-14 11:06:57,306 DEBUG   : root         : Workload [Jankbench 1 image_list_view] disabled
2017-03-14 11:06:57,307 DEBUG   : root         : Workload [Jankbench 1 shadow_grid] disabled
2017-03-14 11:06:57,307 DEBUG   : root         : Workload [Jankbench 1 low_hitrate_text] disabled
2017-03-14 11:06:57,308 DEBUG   : root         : Workload [Jankbench 1 high_hitrate_text] disabled
2017-03-14 11:06:57,308 DEBUG   : root         : Workload [Jankbench 1 edit_text] disabled
2017-03-14 11:06:57,309 DEBUG   : root         : Workload [Jankbench 3 list_view] disabled
2017-03-14 11:06:57,309 DEBUG   : root         : Workload [Jankbench 3 image_list_view] disabled
2017-03-14 11:06:57,309 DEBUG   : root         : Workload [Jankbench 3 shadow_grid] disabled
2017-03-14 11:06:57,310 DEBUG   : root         : Workload [Jankbench 3 low_hitrate_text] disabled
2017-03-14 11:06:57,310 DEBUG   : root         : Workload [Jankbench 3 high_hitrate_text] disabled
2017-03-14 11:06:57,311 DEBUG   : root         : Workload [Jankbench 3 edit_text] disabled
2017-03-14 11:06:57,311 DEBUG   : root         : Workload [UiBench 1 TrivialAnimationActivity 10] disabled
2017-03-14 11:06:57,312 DEBUG   : root         : Workload [RTApp STAccount 6] disabled
2017-03-14 11:06:57,312 DEBUG   : root         : Workload [RTApp RAMP] disabled
2017-03-14 11:06:57,313 INFO    : root         : Enabling collection of: ftrace
2017-03-14 11:06:57,313 INFO    : root         : ------------------------
2017-03-14 11:06:57,313 INFO    : root         : Test 1: YOUTUBE in Y_STD configuration
2017-03-14 11:06:57,314 INFO    : root         :         YouTube 1 https://youtu.be/XSGBVzeBUbk?t=45s   60
2017-03-14 11:06:57,315 DEBUG   : YouTube      : Workload created
2017-03-14 11:06:58,842 INFO    : Screen       : Force manual orientation
2017-03-14 11:06:58,843 INFO    : Screen       : Set orientation: LANDSCAPE
2017-03-14 11:07:00,540 INFO    : Screen       : Set brightness: 0%
2017-03-14 11:07:03,003 INFO    : YouTube      : FTrace START
2017-03-14 11:07:05,037 INFO    : YouTube      : Play video for 60 [s]
2017-03-14 11:08:05,226 INFO    : YouTube      : FTrace STOP
2017-03-14 11:08:09,174 INFO    : Screen       : Set orientation: AUTO
2017-03-14 11:08:10,336 INFO    : Screen       : Set brightness: AUTO
2017-03-14 11:08:10,337 DEBUG   : root         : Workload [Jankbench 1 list_view] disabled
2017-03-14 11:08:10,338 DEBUG   : root         : Workload [Jankbench 1 image_list_view] disabled
2017-03-14 11:08:10,338 DEBUG   : root         : Workload [Jankbench 1 shadow_grid] disabled
2017-03-14 11:08:10,338 DEBUG   : root         : Workload [Jankbench 1 low_hitrate_text] disabled
2017-03-14 11:08:10,339 DEBUG   : root         : Workload [Jankbench 1 high_hitrate_text] disabled
2017-03-14 11:08:10,339 DEBUG   : root         : Workload [Jankbench 1 edit_text] disabled
2017-03-14 11:08:10,340 DEBUG   : root         : Workload [Jankbench 3 list_view] disabled
2017-03-14 11:08:10,340 DEBUG   : root         : Workload [Jankbench 3 image_list_view] disabled
2017-03-14 11:08:10,340 DEBUG   : root         : Workload [Jankbench 3 shadow_grid] disabled
2017-03-14 11:08:10,341 DEBUG   : root         : Workload [Jankbench 3 low_hitrate_text] disabled
2017-03-14 11:08:10,341 DEBUG   : root         : Workload [Jankbench 3 high_hitrate_text] disabled
2017-03-14 11:08:10,342 DEBUG   : root         : Workload [Jankbench 3 edit_text] disabled
2017-03-14 11:08:10,342 DEBUG   : root         : Workload [UiBench 1 TrivialAnimationActivity 10] disabled
2017-03-14 11:08:10,342 DEBUG   : root         : Workload [RTApp STAccount 6] disabled
2017-03-14 11:08:10,343 DEBUG   : root         : Workload [RTApp RAMP] disabled
2017-03-14 11:08:10,343 INFO    : root         : Enabling collection of: systrace
2017-03-14 11:08:10,344 DEBUG   : root         : Workload [YouTube 1 https://youtu.be/XSGBVzeBUbk?t=45s   60] disabled
2017-03-14 11:08:10,344 DEBUG   : root         : Workload [Jankbench 1 list_view] disabled
2017-03-14 11:08:10,345 DEBUG   : root         : Workload [Jankbench 1 image_list_view] disabled
2017-03-14 11:08:10,345 DEBUG   : root         : Workload [Jankbench 1 shadow_grid] disabled
2017-03-14 11:08:10,345 DEBUG   : root         : Workload [Jankbench 1 low_hitrate_text] disabled
2017-03-14 11:08:10,346 DEBUG   : root         : Workload [Jankbench 1 high_hitrate_text] disabled
2017-03-14 11:08:10,346 DEBUG   : root         : Workload [Jankbench 1 edit_text] disabled
2017-03-14 11:08:10,346 DEBUG   : root         : Workload [Jankbench 3 list_view] disabled
2017-03-14 11:08:10,347 DEBUG   : root         : Workload [Jankbench 3 image_list_view] disabled
2017-03-14 11:08:10,347 DEBUG   : root         : Workload [Jankbench 3 shadow_grid] disabled
2017-03-14 11:08:10,348 DEBUG   : root         : Workload [Jankbench 3 low_hitrate_text] disabled
2017-03-14 11:08:10,348 DEBUG   : root         : Workload [Jankbench 3 high_hitrate_text] disabled
2017-03-14 11:08:10,349 DEBUG   : root         : Workload [Jankbench 3 edit_text] disabled
2017-03-14 11:08:10,349 INFO    : root         : ------------------------
2017-03-14 11:08:10,349 INFO    : root         : Test 1: UIBENCH in U_EAS configuration
2017-03-14 11:08:10,350 INFO    : root         :         UiBench 1 TrivialAnimationActivity 10
2017-03-14 11:08:10,350 DEBUG   : UiBench      : Workload created
2017-03-14 11:08:15,709 INFO    : Screen       : Set brightness: 0%
2017-03-14 11:08:16,376 INFO    : Screen       : Force manual orientation
2017-03-14 11:08:16,376 INFO    : Screen       : Set orientation: PORTRAIT
2017-03-14 11:08:18,614 DEBUG   : UiBench      : START string [ActivityManager: START.*cmp=com.android.test.uibench/.TrivialAnimationActivity]
2017-03-14 11:08:18,615 INFO    : UiBench      : adb -s FA6A10306347 logcat ActivityManager:* System.out:I *:S BENCH:*
2017-03-14 11:08:19,125 WARNING : UiBench      : Systrace time NOT defined, tracing for 10[s]
2017-03-14 11:08:19,126 INFO    : UiBench      : Systrace START
2017-03-14 11:08:19,126 INFO    : System       : SysTrace: /home/vagrant/lisa/tools/catapult/systrace/systrace/run_systrace.py -e FA6A10306347 -o /home/vagrant/lisa/results/Android_Multiple_Workloads/u_eas/UiBench_TrivialAnimationActivity/trace.html gfx view sched freq idle -t 10
2017-03-14 11:08:19,132 DEBUG   : UiBench      : Benchmark started!
2017-03-14 11:08:19,133 INFO    : UiBench      : Benchmark [.TrivialAnimationActivity] started, waiting 10 [s]
2017-03-14 11:08:29,140 DEBUG   : UiBench      : Benchmark done!
2017-03-14 11:08:29,141 INFO    : UiBench      : Waiting systrace report [/home/vagrant/lisa/results/Android_Multiple_Workloads/u_eas/UiBench_TrivialAnimationActivity/trace.html]...
2017-03-14 11:08:37,315 INFO    : Screen       : Set orientation: AUTO
2017-03-14 11:08:39,617 INFO    : Screen       : Set brightness: AUTO
2017-03-14 11:08:39,718 DEBUG   : root         : Workload [RTApp STAccount 6] disabled
2017-03-14 11:08:39,719 DEBUG   : root         : Workload [RTApp RAMP] disabled

In [13]:
!tree {te.res_dir}


/home/vagrant/lisa/results/Android_Multiple_Workloads
├── j_eas
│   └── Jankbench_list_view
│       ├── BenchmarkResults
│       ├── platform.json
│       └── trace.dat
├── j_std
│   └── Jankbench_list_view
│       ├── BenchmarkResults
│       ├── platform.json
│       └── trace.dat
├── u_eas
│   └── UiBench_TrivialAnimationActivity
│       ├── framestats.txt
│       ├── platform.json
│       └── trace.html
└── y_std
    └── YouTube_XSGBVzeBUbk_45s
        ├── framestats.txt
        ├── platform.json
        └── trace.dat

8 directories, 12 files