User Tools
eg-ciat:meetings-archive
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision | Next revision Both sides next revision | ||
|
eg-ciat:meetings-archive [2017/07/18 11:57] jsmoeller |
eg-ciat:meetings-archive [2018/10/30 11:58] jsmoeller |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| + | ==== Meeting 2017/12/19 ==== | ||
| + | ===Attendees=== | ||
| + | Jan-Simon Möller, Tim Bird, Frederic Marec, Liu Wenlong, Tetsuji Yamamoto, Kotaro Hashimoto, Stephane Desneux | ||
| + | |||
| + | ===Topics=== | ||
| + | == Fuego == | ||
| + | |||
| + | == Hosting FUEGO call today - welcome ! == | ||
| + | |||
| + | * Release status | ||
| + | * 1.2.1 release was made and announced | ||
| + | * Fixups to OpenSSL, LTP, and other tests | ||
| + | * added support for invoking individual phases | ||
| + | * can do 'build' separate from 'run', for any test | ||
| + | * next Major release areas of focus | ||
| + | * Documentation conversion to reStructuredText | ||
| + | * Documentation for end users (not developers) | ||
| + | * How to customize tests (criteria.json) | ||
| + | * Fuego automated release testing (Fuego selftest) | ||
| + | * Under contract with ProFusion | ||
| + | * System provisioning | ||
| + | * Build and deploy system to target | ||
| + | * Work is currently being done in the 'master' branch | ||
| + | * Activity | ||
| + | * At Japan Jamboree #63 - Tim gave a status report | ||
| + | * Another presentation - Tips and tricks for using Fuego (Feature you didn't know Fuego had) | ||
| + | * Fuego Japan Hackathon | ||
| + | * See http://fuegotest.org/wiki/Japan_Fuego_Hackathon_2017 | ||
| + | * OLD | ||
| + | * Want 'test' integration with LAVA, instead of 'transport'-level integration | ||
| + | * Board farm standards | ||
| + | * provisioning - using libvirt, ttc, labgrid or lava | ||
| + | * Fuego conversion of docs to reStructuredText | ||
| + | * Conversion from Docbook and wiki Markdown to reStructuredText | ||
| + | * Allow use of readthedoc.io for online | ||
| + | * Build documentation from repository (move from wiki) | ||
| + | * Not funded - requested to go back and see if community can perform this | ||
| + | * Fuego release self-testing | ||
| + | * Use Fuego to do Fuego CI testing | ||
| + | * use SeleniumHQ for web interface testing | ||
| + | * use 2-container system (driving container and DUT container, with next release of Fuego) | ||
| + | * Funding was approved | ||
| + | |||
| + | == AGL == | ||
| + | |||
| + | == AGL CIAT meeting == | ||
| + | |||
| + | * Status updates: | ||
| + | * KernelCI | ||
| + | * Setup WIP with LF-IT | ||
| + | * Need newer docker on CentOS 7 (due to docker compose) | ||
| + | * https://jira.automotivelinux.org/browse/SPEC-1208 | ||
| + | * CIBT / LAVA | ||
| + | * need helping hand debugging qemux86-64 target | ||
| + | * https://build.automotivelinux.org/job/ci-platform-meta-agl-demo-verify-CIBT-qemux86-64/283/console | ||
| + | * reproduce: | ||
| + | * build for qemux86-64 and run with runqemu | ||
| + | |||
| + | running for Run pending postinsts (5min 5s / no limit)[K[ [0;31m*[0;1;31m*[0m] A start job is running for Run pending postinsts (5min 5s / no limit)[K[ [0;31m*[0m] A start job is running for Run pending postinsts (5min 6s / no limit)[K[ [0;31m*[0;1;31m*[0m] A start job is running for Run pending postinsts (5min 6s / no limit)[K[ [0;31m*[0;1;31m*[0m[0;31m*[0m] A start job is running for Run pending postinsts (5min 7s / no limit)[K[ [0;31m*[0;1;31m*[0m[0;31m* [0m] A start job is running for Run pending postinsts (5min 7s / no limit)[ | ||
| + | |||
| + | * container build | ||
| + | * Fixed. | ||
| + | * Reports for rc's | ||
| + | * https://wiki.automotivelinux.org/agl-distro/releases/4.99.3/test/summary | ||
| + | |||
| + | ===Next meeting(s)=== | ||
| + | Call in 2 weeks same place, same time (13:00 UTC) . Jan 2nd 2018. | ||
| + | |||
| + | ==== Meeting 2017/11/21 ==== | ||
| + | ==Attendees== | ||
| + | Jan-Simon Möller, Frederic Marec, Daniel Sangorrin, Yuichi Kusakabe, Sebastien Douheret, Liu Wenlong, Tetsuji Yamamoto, Stephane Desneux Ronan, Qiutingting, Kyohhei Oki, Loys Ollivier | ||
| + | |||
| + | ==Topics== | ||
| + | = AGL = | ||
| + | * Status updates: | ||
| + | * KernelCI | ||
| + | * Loys: | ||
| + | * migrated boards to submit to KCi via callback | ||
| + | * https://kernelci.automotivelinux.org:4443 | ||
| + | * releng scripts used by jenkins submit jobs with proper callbacks now | ||
| + | * Next: adding more tests + bugfixes | ||
| + | * LAVA | ||
| + | * Jan-Simon: | ||
| + | * Atm power outage in the core lab | ||
| + | * 2017.10 | ||
| + | * Jenkins | ||
| + | * Had the merge job being retriggered over and over. Fixed now. | ||
| + | * Need to more app repos to ci-management/jjb/ci-apps (EOW) | ||
| + | * Next release: | ||
| + | * rc3 cut-off is 24th Nov | ||
| + | * ptest | ||
| + | * rc4 cut-off is 8th Dec | ||
| + | * ptest | ||
| + | |||
| + | * Open Issues: | ||
| + | * Kingfisher | ||
| + | * aglsetup machine template ? really needed ? | ||
| + | * difference is only: kernel builds another dtb in addition | ||
| + | * u-boot (usually not used) | ||
| + | * additional packages pulled-in (bt firmware, ...) | ||
| + | * -> we don't need a separate template | ||
| + | * challenge: weston.ini ? runtime detect of KF ? | ||
| + | * Preference 1: keep same MACHINE (aglsetup + YP) | ||
| + | * Preference 2: keep same YP machine (aglsetup m3ulcb-kf + YP m3ulcb) | ||
| + | * Avoid: new MACHINE in YP ! | ||
| + | |||
| + | * container build | ||
| + | * https://build.automotivelinux.org/view/jjb-housekeeping-jobs/job/snapshot-jjb-container-weekly/65/console | ||
| + | * SPEC-979 | ||
| + | |||
| + | ==Next meeting(s)== | ||
| + | Call in 2 weeks same place, same time (13:00 UTC) . | ||
| + | |||
| + | |||
| + | ==== Meeting 2017/11/07 ==== | ||
| + | ==Attendees== | ||
| + | Jan-Simon, Tim, Daniel, Stephane | ||
| + | |||
| + | ==Topics== | ||
| + | == Hosting FUEGO call today - welcome ! First 30 minutes Fuego, 2nd 30 minutes AGL-CIAT == | ||
| + | |||
| + | = Fuego = | ||
| + | * OLD | ||
| + | * Fuego status: | ||
| + | * 1.2 release was made, but without announcement | ||
| + | * Major features: | ||
| + | * unified output format (run.json - somewhat compatible with kernelci) | ||
| + | * test dependency system (NEED_xxx variables) | ||
| + | * complex pass criteria handling (criteria.json) | ||
| + | * chart_config.json (foundation for customizing results visualization) | ||
| + | * test improvements (e.g. aarch64 support for old tests) | ||
| + | * documentation fixups | ||
| + | * Pending items for announcements: | ||
| + | * LTP parsing of POSIX results | ||
| + | * More Documentation fixups | ||
| + | * Am now planning on a 1.2.1 release which includes recent bugfixes from Tim, Wenlong and Daniel | ||
| + | * NEW: | ||
| + | * Good discussion with Jan-Simon and Kevin Hilman about LAVA integration | ||
| + | * Currently, we have "transport"-level integration | ||
| + | * We need "test"-level integration | ||
| + | * Kevin offered to be the contractor for this | ||
| + | * Board farm/DUT control automation discussed at ELCE | ||
| + | * Decided to use automated-testing@yoctoproject.org for list | ||
| + | * https://lists.yoctoproject.org/listinfo/automated-testing | ||
| + | * Lots of people doing DUT control projects (libvirt, ttc, labgrid, pduclient) | ||
| + | * would be nice to colaborate | ||
| + | * would be nice to have a DUT control connection standard | ||
| + | * CELP project funding | ||
| + | * Discussed 4 Fuego projects: | ||
| + | * LAVA integration | ||
| + | * needs additional research, CELP deferred funding decision | ||
| + | * Renesas wants to see justification for expense, may push funding request through AGL | ||
| + | * Fuego size test | ||
| + | * also needs additional research - not much interest | ||
| + | * Fuego conversion of docs to reStructuredText | ||
| + | * Conversion from Docbook and wiki Markdown to reStructuredText | ||
| + | * Allow use of readthedoc.io for online | ||
| + | * Build documentation from repository (move from wiki) | ||
| + | * Not funded - requested to go back and see if community can perform this | ||
| + | * Fuego release self-testing | ||
| + | * Use Fuego to do Fuego CI testing | ||
| + | * use SeleniumHQ for web interface testing | ||
| + | * use 2-container system (driving container and DUT container, with next release of Fuego) | ||
| + | * Funding was approved | ||
| + | * Work to be done by ProFusion | ||
| + | * Maybe add support for Jenkins pipelines? | ||
| + | |||
| + | = AGL = | ||
| + | * Status updates: | ||
| + | * KernelCI : test instance up https://kernelci.automotivelinux.org:4443 | ||
| + | * EE 5.0RC2 being built , tests will get notifiers to kCI | ||
| + | * F2F during AMM minutes ... still WIP, will send email | ||
| + | * Loys: what has been done on the kernelCI / releng-scripts / ptest front | ||
| + | * ptest wrapper for lava and submit to kernelCI | ||
| + | * http://kernelci.dev.baylibre.com/test/board/qemu/job/AGL-kernel-tree/kernel/PTEST-02/ | ||
| + | * releng-scripts can now generate jobs for m3, qemu, rpi3 | ||
| + | * goal all CI boards should submit through releng-scripts | ||
| + | * including notifiers for kernelCI | ||
| + | * AMM: | ||
| + | * 2 Talk | ||
| + | * Lab-in-a-box | ||
| + | * Writing test | ||
| + | * Workshop on Friday | ||
| + | |||
| + | * more tests (help welcome!): | ||
| + | * evaluate SPEC-272 and extend services being checked | ||
| + | * need to differ between agl-image-ivi (no gfx) and agl-demo-platform (=profiles in the end) | ||
| + | * e.g. check appfw with curl call | ||
| + | * e.g. check kernel modules being loaded (as per our bbappends+CONFIG options) | ||
| + | * can this be a macro or ptest ? | ||
| + | * AMM: discuss with Jose how to appfw / application (self-)tests | ||
| + | |||
| + | * Next | ||
| + | * Discussion about time for call. Alternate time ? | ||
| + | * E.g. stick with 13:00 UTC | ||
| + | * Alternative time would be e.g. 16:00 UTC | ||
| + | * Stick with 13:00 UTC | ||
| + | |||
| + | ==Next meeting(s)== | ||
| + | Call in 2 weeks same place, same time (13:00 UTC) . | ||
| + | |||
| + | |||
| + | |||
| + | ==== Meeting 2017/10/10 ==== | ||
| + | ==Attendees== | ||
| + | Jan-Simon, Frederic Marec (iot.bzh), Liu Wenlong, Ronan Le Martret, Song Cai, Agustin (Codethink) | ||
| + | |||
| + | ==Topics== | ||
| + | |||
| + | = AGL = | ||
| + | * Status updates: | ||
| + | * KernelCI : Setup progressing, IT working on storage backend. | ||
| + | * Pyro: | ||
| + | * Master now stable and we're about to do an RC1, porter still has issues with gfx. | ||
| + | * SPEC-544: FIXED ! Thanks to Scott Murray, we have a patch to mitigate the problem. | ||
| + | * CI confirms that the boot now works | ||
| + | * more tests (help welcome!): | ||
| + | * evaluate SPEC-272 and extend services being checked | ||
| + | * need to differ between agl-image-ivi (no gfx) and agl-demo-platform (=profiles in the end) | ||
| + | * e.g. check appfw with curl call | ||
| + | * e.g. check kernel modules being loaded (as per our bbappends+CONFIG options) | ||
| + | * can this be a macro or ptest ? | ||
| + | * mid-sized task: can ptest's be wrapped (SPEC-758) | ||
| + | |||
| + | * Next | ||
| + | * EE 5.0RC1 , tests in kCI | ||
| + | * F2F breakout during AMM next tuesday (actually the day before AMM starts, 2pm Salon Mainz-Frankfurt) | ||
| + | * Add your name here: https://wiki.automotivelinux.org/eg-ciat/meetings/2017-oct-f2f | ||
| + | * another short session during the SAT meeting (friday) | ||
| + | * https://wiki.automotivelinux.org/agl-distro/oct2017-f2f | ||
| + | |||
| + | ==Next meeting(s)== | ||
| + | Call in 4 weeks same place, same time. (Due to ELCE in Prague in 2 weeks) | ||
| + | |||
| + | |||
| + | ==== Meeting 2017/09/26 ==== | ||
| + | ==Attendees== | ||
| + | Jan-Simon, Tim, Stephane, | ||
| + | |||
| + | ==Topics== | ||
| + | |||
| + | = AGL CIAT = | ||
| + | |||
| + | * Status updates: | ||
| + | * KernelCI instance in preparation with LFIT (ETA Thu) | ||
| + | * Pyro: | ||
| + | * Master works in CI, Tests fail more frequently due to SPEC-544! | ||
| + | * Dab (morty) working perfectly fine | ||
| + | * Test job for EE rc1 (check for the running/required services, SPEC-272, merged, Loys (baylibre) | ||
| + | * Document how to add tests and use the generator/templates (c11029/Baylibre) | ||
| + | * Open Round: | ||
| + | * build chrome as app | ||
| + | * igalia working on chrom+wayland (renesas platform) | ||
| + | * currently being done as 'platform build' (aka with bitbak/yocto) | ||
| + | * issues with ivi-shell, thus fallback to desktop-shell | ||
| + | * iot.bzh did research on app build: | ||
| + | * https://github.com/iotbzh/chromium-agl-app | ||
| + | * build as app can save resources - thus interesting for CI | ||
| + | * focus on renesas gen3, qemu broken (libav) | ||
| + | * AI: add https://github.com/iotbzh/chromium-agl-app/blob/master/meta-sdk-chrom/recipes-platform/images/agl-demo-platform-crosssdk.bbappend to agl-demo-platform-crosssdk.bb | ||
| + | * AI: add JIRA for vetting of other TOOLCHAIN_HOST_TASK TOOLCHAIN_TARGET_TASK for EE. | ||
| + | * App builds in CI are for master/snapshot. AI: add release builds for dab but this requires dab branch in app repos (-> devcall/sat) | ||
| + | * Next: | ||
| + | * kCI token setup for lava.automotivelinux.org | ||
| + | * SPEC-544 (serial/udev issue) (Scott/Konsulko) | ||
| + | * more tests (help welcome!): | ||
| + | * evaluate SPEC-272 and extend services being checked | ||
| + | * need to differ between agl-image-ivi (no gfx) and agl-demo-platform (=profiles in the end) | ||
| + | * e.g. check appfw with curl call | ||
| + | * e.g. check kernel modules being loaded (as per our bbappends+CONFIG options) | ||
| + | * can this be a macro or ptest ? | ||
| + | * mid-sized task: can ptest's be wrapped (SPEC-) | ||
| + | * AI: test latest Fuego with nbd patchset | ||
| + | |||
| + | |||
| + | ==Next meeting(s)== | ||
| + | In 2 weeks | ||
| + | |||
| + | |||
| + | ==== Meeting 2017/09/12 ==== | ||
| + | ==Attendees== | ||
| + | Jan-Simon, Tim Bird, Agustin, Daniel, Liu Wenglong, Patrick Titiano, Hashimoto-san, Jerome Brunet | ||
| + | |||
| + | ==Topics== | ||
| + | == Hosting FUEGO call today - welcome ! == | ||
| + | |||
| + | * NEW: | ||
| + | * Fuego status: | ||
| + | * Working towards 1.2 release | ||
| + | * 4 main items (see http://bird.org/fuego-1.2/Releases and http://bird.org/fuego-1.2/Release_1.2_To_Do) | ||
| + | * unified output format (run.json) - basically done | ||
| + | * AGL/JTA reports - in progress (see html table work by Daniel) | ||
| + | * Full LTP support - basically done, needs testing | ||
| + | * Wenlong Liu and Cai Song have been testing, and submitted patches (thanks!) | ||
| + | * updated wiki documentation - started | ||
| + | * long-term plan: move to reStructuredText (readthedocs/sphynx) | ||
| + | * LAVA integration - was deferred (had added target_setup_link/target_teardown_link) | ||
| + | * Jan said I can integrate the existing pull request | ||
| + | * Tim will do that | ||
| + | * Broken stuff | ||
| + | * Fuego plots on Jenkins pages | ||
| + | * put chart processing in the parser, not mod.js (part of flot package) | ||
| + | * output a flot-friendly json file (flot_chart_data.json) | ||
| + | * chart_config.json | ||
| + | * Fuego standalone plots | ||
| + | * New Features | ||
| + | * ftc gen-report (prototype, output=text for now) | ||
| + | * criteria.json | ||
| + | * testplan_ltsi.json | ||
| + | * html tables for functional tests on Jenkins | ||
| + | * results.json | ||
| + | * new presentation: Integration of Fuego with Gitlab | ||
| + | * plans for the future: | ||
| + | * move documentation into Fuego repository (under git control) | ||
| + | * have ftc gen-report output multiple formats | ||
| + | * text, html, pdf, xunit, TAP) | ||
| + | * year 2038 test | ||
| + | * big push for new tests | ||
| + | * kselftest | ||
| + | * upstream kernel is converting to TAP output | ||
| + | * CAN bus test | ||
| + | * integrate Khiem Nguyen's test (LTSI/Renesas board test) | ||
| + | * CIP tests | ||
| + | * AGL tests | ||
| + | * BayLibre - doing some test development for AGL (infrastructure for kernelci) | ||
| + | * Also doing a test-in-a-box | ||
| + | * Tim doing Linaro Connect presentation on test standards | ||
| + | * pduclient | ||
| + | * tguids | ||
| + | * run.json (kerneci results format - with fuego stuff) | ||
| + | |||
| + | == AGL CIAT == | ||
| + | |||
| + | * Status updates: | ||
| + | * KernelCI additions in mainline now for displaying testresults (not just boot) | ||
| + | * Instance being setup by LFIT | ||
| + | * Pyro: | ||
| + | * Master broken in CI due to failing builds | ||
| + | * Dab (morty) working perfectly fine | ||
| + | * Next: | ||
| + | * Planned for EOW next week KernelCI instance (LFIT) | ||
| + | * Test job for EE rc1 (check for the running/required services jsmoelelr) | ||
| + | * SPEC-544 (serial/udev issue) (Scott/Konsulko) | ||
| + | * Document how to add tests and use the generator/templates (Kevin/Baylibre) | ||
| + | |||
| + | ==Next meeting(s)== | ||
| + | In 2 weeks | ||
| + | (2017/09/26) | ||
| + | |||
| + | ==== Meeting 2017/08/29 ==== | ||
| + | |||
| + | ==Attendees== | ||
| + | Jan-Simon, Agustin, Daniel, Hashimoto-san, Liu Wenglong, Patrick Titiano, Robert Marshall | ||
| + | |||
| + | ==Topics== | ||
| + | |||
| + | * Board@Desk presentation (Agustin) | ||
| + | * Slides can be found in the [[https://wiki.linuxfoundation.org/_media/civilinfrastructureplatform/testing_at_cip__b_d.pdf|CIP wiki in .pdf]] format. | ||
| + | * Open round | ||
| + | |||
| + | ==Next meeting(s)== | ||
| + | In 2 weeks | ||
| + | |||
| + | -------- | ||
| + | ==== Meeting 2017/08/14 ==== | ||
| + | |||
| + | ==Attendees== | ||
| + | |||
| + | ==Topics== | ||
| + | == Hosting FUEGO call today - welcome ! == | ||
| + | |||
| + | * NEW: | ||
| + | * We'll skip today's Fuego call then. | ||
| + | * The next CIAT meeting is in 2 weeks. | ||
| + | |||
| + | ==Next meeting(s)== | ||
| + | In 2 weeks | ||
| + | |||
| + | -------- | ||
| + | |||
| + | ==== Meeting 2017/08/01 ==== | ||
| + | |||
| + | ==Attendees== | ||
| + | Jan-Simon, Walt, Cai, Jerome, Keisuke Iwata, Liu Wenlong, Agustin | ||
| + | |||
| + | ==Topics== | ||
| + | |||
| + | * OLD topics: | ||
| + | * Hardware test template for qemu (x86-64) | ||
| + | * **Update 01/08**: Enabled | ||
| + | * planning start the 'generic-*' | ||
| + | * Service/Unit 'up' test | ||
| + | * **Update 01/08**: | ||
| + | * | ||
| + | * Lava upstream work: | ||
| + | * **Update 01/08**: | ||
| + | * Merged: https://review.linaro.org/#/c/20688/ | ||
| + | * WIP: https://review.linaro.org/#/c/17088/ | ||
| + | * KernelCI work: | ||
| + | * **Update 01/08**: | ||
| + | * https://jira.automotivelinux.org/browse/SPEC-746 | ||
| + | * Multi-lava-lab support in CI merged | ||
| + | * Focus: test submission template, likely jinja2 templates as in lava | ||
| + | * https://github.com/khilman/lava-ci-staging/commit/3da1fbf931057d55f46c46194ffdf433a9b0e881 | ||
| + | * http://lava.baylibre.com:10080/scheduler/job/923/definition | ||
| + | | ||
| + | * JIRA review: | ||
| + | * Reviewing https://jira.automotivelinux.org/issues/?filter=10405 | ||
| + | |||
| + | ==Next meeting(s)== | ||
| + | In 2 weeks | ||
| + | Aug 15th, 12:00 UTC (joint AGL + FUEGO) | ||
| + | |||
| + | |||
| + | |||
| + | |||
| + | ==== Meeting 2017/07/18 ==== | ||
| + | |||
| + | ==Attendees== | ||
| + | Jan-Simon Möller, Cai Song, Keisuke Iwata, Liu Wenlong, Stephane Desneux, Daniel Sangorrin | ||
| + | |||
| + | ==Topics== | ||
| + | |||
| + | == First ~30 minutes - hosting FUEGO call today - welcome ! == | ||
| + | |||
| + | * NEW: | ||
| + | * Top issues: | ||
| + | - unified json output | ||
| + | - lava integration | ||
| + | - Daniel provided kernel build test | ||
| + | - flot plugin, output refactoring is in support some new test comparison operation and reporting | ||
| + | * Major feature remaining for 1.2 is the unified json output, and support for AGL reports | ||
| + | - Goal would be to release 1.2 in mid-July. | ||
| + | * Unordered List Item* Unified Output Format (UOF) | ||
| + | * Daniel showed format of reference.json, with new "pass-criteria" | ||
| + | * Unordered List Item Tim talked about needing to share pass-criteria, and how to store and use them for a test | ||
| + | * specifically alternate pass-criteria | ||
| + | * Daniel showed different files for the new output format | ||
| + | * schema, reference.json, run.json, results.json, and png of possible report format | ||
| + | * some questions came up: | ||
| + | * should the results.json (the aggregate data from multiple runs) contain the pass-criteria or reference data)? | ||
| + | * it's easier to parse for the plotter without this | ||
| + | * should pass-criteria be separate from the reference.json file? | ||
| + | * should customized or alternate pass-criteria be stored in diff format or as full json files? | ||
| + | * code to produce the html is in Daniel's next repository | ||
| + | * Daniel has a new interface for generating the measurement data (parser.py) | ||
| + | * parser.py builds a data structure, and calls plib.process_data to both record the data (measurements) and evaluate the pass criteria from the reference.json file | ||
| + | * Tim commented that the bonnie parser.py could be simplified with a function to put operations together | ||
| + | * something like: add_measure("block.read","speed",float(5)) | ||
| + | * More discussion of the issues will be raised on the mailing lists | ||
| + | * interesting option is to use a web-based transfer to target | ||
| + | * Tim started a prototype of this | ||
| + | * Could transfer commands as well as test materials, using a client pull rather than host push | ||
| + | * need an agent on target for this | ||
| + | * eliminates the need for an ssh connection, but requires a web host (maybe can use Jenkins for this) | ||
| + | |||
| + | * OLD - some miscellaneous technical issues | ||
| + | * automatically create a view for each board (using regex of: "<board_name>.*") (done) | ||
| + | * put log links (and others) in description even if job fails (done) | ||
| + | * don't require buildsetter plugin (defer) | ||
| + | * automatically detect log, plot and xlsx files | ||
| + | * support partial results | ||
| + | * lots of times there is a test log there, even if the build failed | ||
| + | * try to eliminate need for extralinks in testplan file (done - not there anymore) | ||
| + | * eliminate need for timeout in testplan file (not needed, if default is used) | ||
| + | * do a better job of automatically calculating timeouts | ||
| + | * this is dependent on test, spec, board and other parameter | ||
| + | |||
| + | * NEW: | ||
| + | * a | ||
| + | * b | ||
| + | |||
| + | |||
| + | == AGL-CIAT Meeting: == | ||
| + | |||
| + | * OLD topics: | ||
| + | * Related issue: device_type names in lava need to be converted to match DTB name | ||
| + | * **Update 04/07**: In preparation | ||
| + | * **Update 18/07**: ETA this week to cut-over all labs | ||
| + | * Stephane: weston startup to be worked on. Also looks into virtual screens for simulation purposes (e.g. including faking EDIDs). Tests must be independent of the compositor going forward. | ||
| + | * Tests initially +/- or Fail/Pass | ||
| + | * testdefinition: https://git.automotivelinux.org/src/qa-testdefinitions/tree/test-suites/short-smoke | ||
| + | * test run: https://lava.automotivelinux.org/scheduler/job/1798 | ||
| + | * Next: enable on all boards and activate in ci | ||
| + | * **Update 04/07**: busy w/ dd prep | ||
| + | * **Update 18/07**: not yet | ||
| + | * SPEC-495 - Template for apps (cmake, tbd. qmake, fallback Makefile) | ||
| + | * Autobuild script for CI: | ||
| + | * qmake needed for current demo apps | ||
| + | * requirements: git clone (or git submodule) , clone and calling of script will build app with autodetected method (qmake, cmake, autotools, Makefile) | ||
| + | * app templates usable as git submodules (atm: cmake) | ||
| + | * Workflow: | ||
| + | * clone (recursive) | ||
| + | * [[ -f conf.d/autobuild/agl/autobuild ]] && conf.d/autobuild/agl/autobuild package DEST=$(pwd)/package/ (pickup is package/*.wgt) | ||
| + | * + generic procedure (call make as fallback) | ||
| + | * new JIRA for qmake macros | ||
| + | * **Update 20/06**: Templates enhanced, no Autobuild for CI, yet | ||
| + | * **Update 18/07**: Changesets merged in gerrit, doc pending, qmake pending | ||
| + | |||
| + | * JIRA review: | ||
| + | * Reviewing https://jira.automotivelinux.org/issues/?filter=10405 | ||
| + | |||
| + | * NEW topics: | ||
| + | * a | ||
| + | ==Next meeting(s)== | ||
| + | In 2 weeks | ||
| + | Aug 1st, 12:00 UTC | ||
| + | |||
| + | |||
| + | ---- | ||
| + | ==== Meeting 2017/07/04 ==== | ||
| + | |||
| + | ==Attendees== | ||
| + | Jan-Simon, Daniel, Iwata-san, Hashimoto-san, Liu Wenlong, Oki-san, Stephane, Agustin | ||
| + | |||
| + | ==Topics== | ||
| + | |||
| + | * OLD topics: | ||
| + | * Hardware test template for gen3 | ||
| + | * **Update 04/07**: Added, activation changeset pendinng in gerrit | ||
| + | * Related issue: device_type names in lava need to be converted to match DTB name | ||
| + | * **Update 04/07**: In preparation | ||
| + | * Stephane: weston startup to be worked on. Also looks into virtual screens for simulation purposes (e.g. including faking EDIDs). Tests must be independent of the compositor going forward. | ||
| + | * Tests initially +/- or Fail/Pass | ||
| + | * Next: create check if services are up | ||
| + | * https://jira.automotivelinux.org/browse/SPEC-275 | ||
| + | * https://jira.automotivelinux.org/browse/SPEC-305 | ||
| + | * Target have tests scripts | ||
| + | * Build-up: | ||
| + | * basic "service up" | ||
| + | * then "client connect" | ||
| + | * then "request/answer" | ||
| + | * **Update 20/06**: WIP | ||
| + | * testdefinition: https://git.automotivelinux.org/src/qa-testdefinitions/tree/test-suites/short-smoke | ||
| + | * test run: https://lava.automotivelinux.org/scheduler/job/1798 | ||
| + | * Next: enable on all boards and activate in ci | ||
| + | * **Update 04/07**: busy w/ dd prep | ||
| + | * SPEC-495 - Template for apps (cmake, tbd. qmake, fallback Makefile) | ||
| + | * add optional script there, bbclass add generic script if no script is there. | ||
| + | * yocto SDK installs too-much debug-packages (e.g. from platform) | ||
| + | * https://git.automotivelinux.org/apps/app-templates/tree/ | ||
| + | * templates to be used with submodules | ||
| + | * cmake template and sample https://github.com/iotbzh/helloworld-service | ||
| + | * Autobuild script for CI: | ||
| + | * qmake needed for current demo apps | ||
| + | * requirements: git clone (or git submodule) , clone and calling of script will build app with autodetected method (qmake, cmake, autotools, Makefile) | ||
| + | * **Update 20/06**: Templates enhanced, no Autobuild for CI, yet | ||
| + | * app templates usable as git submodules (atm: cmake) | ||
| + | * Workflow: | ||
| + | * clone (recursive) | ||
| + | * [[ -f conf.d/autobuild/agl/autobuild ]] && conf.d/autobuild/agl/autobuild package DEST=$(pwd)/package/ (pickup is package/*.wgt) | ||
| + | * + generic procedure (call make as fallback) | ||
| + | * new JIRA for qmake macros | ||
| + | |||
| + | * NEW topics: | ||
| + | * Reviewing https://jira.automotivelinux.org/issues/?filter=10405 | ||
| + | * https://jira.automotivelinux.org/browse/SPEC-502 ?? Review later | ||
| + | * https://jira.automotivelinux.org/browse/SPEC-237 ?? Status ? | ||
| + | |||
| + | ==Next meeting(s)== | ||
| + | In 2 weeks | ||
| + | July 18th, 12:00 UTC (joint AGL + FUEGO) | ||
| + | |||
| + | |||
| + | ---- | ||
| + | |||
| + | |||
| + | ==== Meeting 2017/06/20 ==== | ||
| + | |||
| + | ==Attendees== | ||
| + | |||
| + | ==Topics== | ||
| + | |||
| + | |||
| + | == First ~30 minutes - hosting FUEGO call today - welcome ! == | ||
| + | |||
| + | * OLD: | ||
| + | * a | ||
| + | * NEW: | ||
| + | * b | ||
| + | |||
| + | | ||
| + | == 2nd ~30 minutes - hosting AGL CIAT call today - welcome ! == | ||
| + | |||
| + | * OLD topics: | ||
| + | * Hardware test template for gen3 | ||
| + | * **Update 13/06**: Activation in CI pending | ||
| + | * **Update 20/06**: no time, yet | ||
| + | * Related issue: device_type names in lava need to be converted to match DTB name | ||
| + | * Stephane: weston startup to be worked on. Also looks into virtual screens for simulation purposes (e.g. including faking EDIDs). Tests must be independent of the compositor going forward. | ||
| + | * Tests initially +/- or Fail/Pass | ||
| + | * Next: create check if services are up | ||
| + | * https://jira.automotivelinux.org/browse/SPEC-275 | ||
| + | * https://jira.automotivelinux.org/browse/SPEC-305 | ||
| + | * Target have tests scripts | ||
| + | * Build-up: | ||
| + | * basic "service up" | ||
| + | * then "client connect" | ||
| + | * then "request/answer" | ||
| + | * **Update 13/06**: Examples are here: | ||
| + | * **Update 20/06**: WIP | ||
| + | * testdefinition: https://git.automotivelinux.org/src/qa-testdefinitions/tree/test-suites/short-smoke | ||
| + | * test run: https://lava.automotivelinux.org/scheduler/job/1798 | ||
| + | * Next: enable on all boards and activate in ci | ||
| + | * SPEC-495 - Template for apps (cmake, tbd. qmake, fallback Makefile) | ||
| + | * Move new templates to gerrit repo (SPEC-556) | ||
| + | * add optional script there, bbclass add generic script if no script is there. | ||
| + | * yocto SDK installs too-much debug-packages (e.g. from platform) | ||
| + | * https://git.automotivelinux.org/apps/app-templates/tree/ | ||
| + | * templates to be used with submodules | ||
| + | * cmake template and sample https://github.com/iotbzh/helloworld-service | ||
| + | * Autobuild script for CI: | ||
| + | * qmake needed for current demo apps | ||
| + | * requirements: git clone (or git submodule) , clone and calling of script will build app with autodetected method (qmake, cmake, autotools, Makefile) | ||
| + | * **Update 20/06**: Templates enhanced, no Autobuild for CI, yet | ||
| + | |||
| + | * NEW topics: | ||
| + | * Reviewing https://jira.automotivelinux.org/issues/?filter=10405 | ||
| + | * https://jira.automotivelinux.org/browse/SPEC-502 ?? Review later | ||
| + | * https://jira.automotivelinux.org/browse/SPEC-237 ?? Status ? | ||
| + | |||
| + | ==Next meeting(s)== | ||
| + | In 2 weeks ... but Independency Day in US | ||
| + | July 4th, 12:00 UTC | ||
| + | |||
| + | |||
| + | -------- | ||
| + | |||
| + | ==== Meeting 2017/06/13 ==== | ||
| + | |||
| + | ==Attendees== | ||
| + | Jan-Simon, Walt, Michael, Agustin, Cai Song, Daniel, Liu Wenlong, Stephane Desneux, Matsuzawa-san, Ronan Le Martret, Kyohhei Oki, | ||
| + | |||
| + | ==Topics== | ||
| + | * OLD topics: | ||
| + | * Hardware test template for gen3 | ||
| + | * **Update 13/06**: Solved, board online. | ||
| + | * **Update 13/06**: Activation in CI pending | ||
| + | * lava-test-shell (overlay), LAVA-911, SPEC-555 | ||
| + | * **Update 13/06**: works with transfer_overlay and webserver on slave. | ||
| + | * Stephane: weston startup to be worked on. Also looks into virtual screens for simulation purposes (e.g. including faking EDIDs). Tests must be independent of the compositor going forward. | ||
| + | * Tests initially +/- or Fail/Pass | ||
| + | * Next: create check if services are up | ||
| + | * https://jira.automotivelinux.org/browse/SPEC-275 | ||
| + | * https://jira.automotivelinux.org/browse/SPEC-305 | ||
| + | * Target have tests scripts | ||
| + | * Build-up: | ||
| + | * basic "service up" | ||
| + | * then "client connect" | ||
| + | * then "request/answer" | ||
| + | * Update 23/95: no update | ||
| + | * Update 13/06: script ? | ||
| + | * **Update 13/06**: Examples are here: | ||
| + | * testdefinition: https://git.automotivelinux.org/src/qa-testdefinitions/tree/test-suites/short-smoke | ||
| + | * test run: https://lava.automotivelinux.org/scheduler/job/1798 | ||
| + | * Next: enable on all boards and activate in ci | ||
| + | * SPEC-495 - Template for apps (cmake, tbd. qmake, fallback Makefile) | ||
| + | * Move new templates to gerrit repo (SPEC-556) | ||
| + | * add optional script there, bbclass add generic script if no script is there. | ||
| + | * yocto SDK installs too-much debug-packages (e.g. from platform) | ||
| + | * https://git.automotivelinux.org/apps/app-templates/tree/ | ||
| + | * templates to be used with submodules | ||
| + | * cmake template and sample https://github.com/iotbzh/helloworld-service | ||
| + | * Autobuild script for CI: | ||
| + | * qmake needed for current demo apps | ||
| + | * requirements: git clone (or git submodule) , clone and calling of script will build app with autodetected method (qmake, cmake, autotools, Makefile) | ||
| + | * SDK and qt headers not included | ||
| + | * Fixed sdk build here: | ||
| + | * arm32 : https://download.automotivelinux.org/AGL/snapshots/master/latest/raspberrypi3/deploy/sdk/ | ||
| + | * aarch64 : https://download.automotivelinux.org/AGL/snapshots/master/latest/dragonboard-410c/deploy/sdk/ | ||
| + | * x86-64 : https://download.automotivelinux.org/AGL/snapshots/master/latest/intel-corei7-64/deploy/sdk/ | ||
| + | * can be used for targets that have the same architecture (e.g. rpi3 also for porter or vayu, dragon for m3/h3, intel-corei7-64 for qemux86-64) | ||
| + | * **Update 13/06**: App builds active in jenkins. currently using above URL's (not yet the container) | ||
| + | |||
| + | ==Next meeting(s)== | ||
| + | next week (+ fuego) | ||
| + | June 20, 12:00 UTC | ||
| + | |||
| + | |||
| + | -------- | ||
| + | |||
| + | ==== Meeting 2017/05/23 ==== | ||
| + | |||
| + | ==Attendees== | ||
| + | Jan-Simon, Walt Miner, Harunobu Kurokawa, Liu Wenlong, Patrick Titiano, Takahi Matsuzawa, Tim Bird, Cai Song, Kyohhei Oki , Agustin Benito Bethencourt | ||
| + | |||
| + | ==Topics== | ||
| + | |||
| + | == First ~30 minutes - hosting FUEGO call today - welcome ! == | ||
| + | |||
| + | * OLD: | ||
| + | * Top issues: | ||
| + | - unified json output | ||
| + | - patch for functional tests produce a results.json file | ||
| + | - discussion on the kernelci results schema (on the fuego mailing list) | ||
| + | - Kevin Hillman started discussion - Daniel responded | ||
| + | - Daniel added some fields to the run.json (don't know if that's related to discussion) | ||
| + | - Lots of work already done in kernelci - should reuse their expertise (if in doubt) | ||
| + | - Will probably err on the side of too much info | ||
| + | - contact xxx for discussion of fields and schema used by kernelci | ||
| + | - Song said that they are working on LTP as higher priority | ||
| + | - lava integration | ||
| + | - ov_transport_connect/disconnect is goal | ||
| + | - have added TARGET_TEARDOWN_LINK | ||
| + | - shorter connection times | ||
| + | - refactored connection/disconnection location in pre_test and post_test | ||
| + | - standalone build phase | ||
| + | - prototype with LTP (build_only) | ||
| + | - specialized solution - would like a more general one | ||
| + | - maybe something like rpm phase selection | ||
| + | - Would like to execute jobs in batch job in the same order as the testplan | ||
| + | - this would support having a "board setup" job at the beginning of a sequence of jobs | ||
| + | - unify the test types | ||
| + | - gotten rid of distinction between functional and benchmark tests | ||
| + | - main.sh | ||
| + | - every test, whether Functional or Benchmark, now uses 'fuego_test.sh' as the base script name. | ||
| + | - Daniel provided kernel build test | ||
| + | - added support for git repository checkout and build | ||
| + | - Has a patch in-flight that does kselftest | ||
| + | - flot plugin, output refactoring is in support some new test comparison operation and reporting | ||
| + | - goal is to support previous JTA use cases and ALG-JTA use cases for reporting in 1.2 release | ||
| + | - Testing BOF at ALS, June 2, 2:00 pm | ||
| + | - Tentative plan private meeting at ALS, on May 31, at 10:00 am. | ||
| + | - Major feature remaining for 1.2 is the unified json output, and support for AGL reports | ||
| + | - Goal would be to release 1.2 in mid-July. | ||
| + | * status of toshiba/sony merge | ||
| + | * made the 1.1 release ("blaze") | ||
| + | * resolving technical issues with Tim's 'next' branch (based on Daniel's 'next' branch) (done) | ||
| + | * priority list for AGL, to start that merge | ||
| + | * LAVA integration | ||
| + | * is 'uniform test output' a high-priority feature? (yes) | ||
| + | * interesting option is to use a web-based transfer to target | ||
| + | * Tim started a prototype of this | ||
| + | * Could transfer commands as well as test materials, using a client pull rather than host push | ||
| + | * need an agent on target for this | ||
| + | * eliminates the need for an ssh connection, but requires a web host (maybe can use Jenkins for this) | ||
| + | * planning for an official fuego release (done) | ||
| + | * 1.1.0 release, code name: blaze | ||
| + | * some miscellaneous technical issues | ||
| + | * TESTNAME (base script name) is derived from the test name (<prefix>.testname) | ||
| + | * use of spec name in job name, instead of plan name (done) | ||
| + | * add node and job scripts to ftc (done) | ||
| + | * eliminate fuego-ro/scripts (done) | ||
| + | * move /fuego-ro/conf/boards to /fuego-ro/boards (done) | ||
| + | * AGL has lava scripts in /fuego-ro, and some board-related stuff | ||
| + | * in boards, auth files for LAVA | ||
| + | * in fuego-ro/scripts - 2 scripts (for link setup and teardown) | ||
| + | * defer looking at this right now | ||
| + | * automatically create a view for each board (using regex of: "<board_name>.*") (done) | ||
| + | * put log links (and others) in description even if job fails (done) | ||
| + | * don't require buildsetter plugin (defer) | ||
| + | * automatically detect log, plot and xlsx files | ||
| + | * support partial results | ||
| + | * lots of times there is a test log there, even if the build failed | ||
| + | * try to eliminate need for extralinks in testplan file (done - not there anymore) | ||
| + | * eliminate need for timeout in testplan file (not needed, if default is used) | ||
| + | * do a better job of automatically calculating timeouts | ||
| + | * this is dependent on test, spec, board and other parameter | ||
| + | |||
| + | * NEW: | ||
| + | |||
| + | == AGL-CIAT Meeting: == | ||
| + | |||
| + | * OLD topics: | ||
| + | * Hardware test template for porter & vayu | ||
| + | * Update 05/23: both active | ||
| + | * issue with serial port bringup/systemd - CIP had similar issue | ||
| + | * See https://jira.automotivelinux.org/browse/SPEC-544 | ||
| + | * Leads to false positives | ||
| + | * gen3 poweron issue - WOL capabilities ? Likely reworking board. | ||
| + | * One missing piece: lava-test-shell (overlay), LAVA-911, SPEC-555 | ||
| + | * Stephane: weston startup to be worked on. Also looks into virtual screens for simulation purposes (e.g. including faking EDIDs). Tests must be independent of the compositor going forward. | ||
| + | * Tests initially +/- or Fail/Pass | ||
| + | * Next: create check it is up | ||
| + | * https://jira.automotivelinux.org/browse/SPEC-275 | ||
| + | * https://jira.automotivelinux.org/browse/SPEC-305 | ||
| + | * Target have tests scripts | ||
| + | * Build-up: | ||
| + | * basic "service up" | ||
| + | * then "client connect" | ||
| + | * then "request/answer" | ||
| + | * Update 05/23: no update | ||
| + | * SPEC-495 - Script to build apps | ||
| + | * Move new templates to gerrit repo (SPEC-556) | ||
| + | * add optional script there, bbclass add generic script if no script is there. | ||
| + | * yocto SDK installs too-much debug-packages (e.g. from platform) | ||
| + | * NEW topics: | ||
| + | * SDK and qt headers not included | ||
| + | * Fixed sdk build here: | ||
| + | * arm32 : https://download.automotivelinux.org/AGL/snapshots/master/latest/raspberrypi3/deploy/sdk/ | ||
| + | * aarch64 : https://download.automotivelinux.org/AGL/snapshots/master/latest/dragonboard-410c/deploy/sdk/ | ||
| + | * x86-64 : https://download.automotivelinux.org/AGL/snapshots/master/latest/intel-corei7-64/deploy/sdk/ | ||
| + | * can be used for targets that have the same architecture (e.g. rpi3 also for porter or vayu, dragon for m3/h3, intel-corei7-64 for qemux86-64) | ||
| + | * WIP: application builds in jenkins | ||
| + | |||
| + | |||
| + | |||
| + | ==Next meeting(s)== | ||
| + | |||
| + | June 6, 12:00 UTC | ||
| + | |||
| + | -------- | ||
| + | |||
| ==== Meeting 2017/04/25 ==== | ==== Meeting 2017/04/25 ==== | ||
eg-ciat/meetings-archive.txt · Last modified: 2022/10/11 11:53 by jsmoeller
Page Tools
