User Tools

Site Tools


eg-ciat:meetings

This is an old revision of the document!


EG CIAT bi-weekly call

Dial In info

In addition to the conference call and web meeting, meetings use IRC channel #automotive on freenode.net

1. To join the meeting go to https://global.gotomeeting.com/join/997304269

2. Preferred method is to use your microphone and speakers (VoIP) - a headset is recommended. Or, call in using your telephone.

Australia: +61 2 9091 7603 Italy: +39 0 699 26 68 65
Austria: +43 (0) 7 2088 0716 Japan (toll-free): 0 120 242 200
Belgium: +32 (0) 28 08 4372 Netherlands: +31 (0) 208 080 759
Canada: +1 (647) 497-9380 New Zealand: +64 9 974 9579
Canada (toll-free): 1 877 777 3281 Norway: +47 21 04 30 59
Denmark: +45 (0) 69 91 84 58 Spain: +34 931 76 1534
Finland: +358 (0) 931 58 1773 Sweden: +46 (0) 852 500 691
France: +33 (0) 170 950 590 Switzerland: +41 (0) 435 0026 89
Germany: +49 (0) 692 5736 7300 United Kingdom: +44 (0) 20 3713 5011
India (toll-free): 000 800 100 8227 United States (toll-free): 1 877 309 2073
Ireland: +353 (0) 15 360 756 United States: +1 (312) 757-3119

Access Code: 997-304-269
Audio PIN: Shown after joining the meeting

Meeting ID: 997-304-269


Roadmap for 2018

  • Lab in a box
    • Board management
    • Board on developer's desk
  • Improved publishing of test results
    • UI improvements to KCi
  • Additional tests
    • Applications
      • test output should use TAP as output format
      • work out example test for one application
    • Platform
      • ptests (embedded in the yocto recipes)
    • BSPs
      • KSelfTest
  • Fuego integration
    • Support to run tests as lava jobs (from within Fuego)
    • BSP integration

Meeting 2018/07/18

Attendees

Jan-Simon, Frederic, Ronan, Tanibata-san, Li Xiaoming

== AGL CIAT meeting ==

Topics

  • Status updates:
    • Infra:
        • Further investigation needed based on Dominigs email.
          • Need to try pxe next
        • Update 2018-06-26: Input during ALS, working sample with ipxe shown. Doc to be sent to ML.
          • Liu showed procedure
            • Advanced Network stack enabled.
            • Enable network boot in bios boot config screen (Fixed boot order)
            • build IPXE from git.ipxe.org/ipxe.git ; cd ipxe/src
            • shell.ipxe:
              • #!ipxe
              • shell
            • make bin-x86_64-efi/ipxe.efi EMBED=./shell.ipxe
          • Frederic: got pxe shell and network boot
        • Update 2018-07-18:
      • download server speed issues under investigation
        • for now we doubled the speed … = ~1.5MB/s max
        • Debugging ongoing, workaround for CI WIP
        • Update 2018-06-26: Seems to be an upstream ISP issue. Workaround seems in place but no final Solution atm.
        • Update 2018-07-18: Cloud internal network structure changed (slaves on own private net now)
    • Lava
      • waiting for LAVA rev. 2018.04 to be ready in lava-docker
      • Means we also have to update the slaves (=new version of lava-dispatcher)
      • WIP: uprev slaves.
      • Update 2018-06-26: Schedule next week (week 27) for lab uprev.
      • Update 2018-07-18: Jan-Simon started to uprev the AGL-core-lab and uses the lava-docker
    • KernelCI
      • webui changes WIP
        • tabs for gerrit/CI , weekly, daily, release builds
        • Update 2018-06-26: demo last week during ALS, plan to deploy week 27
        • Update 2018-07-18: no update, delayed
    • Fuego
      • any update ? - 2018-05-15: no updates
        • 2018-05-29: no update on lava support
        • Update 2018-06-26: Presentation during ALS with better integration (add link)
        • 2018-07-18: no patches for integration, yet.
  • Current issues:
    • SPEC-1378
      • Update 2018-05-29: wip
      • Update 2018-06-12: wip
      • Update 2018-06-26: Reduce build frequency to RC's final / ondemand / move proper container to release folder.
      • Update 2018-07-18: no news
    • New nbd client (proposal by Dominig) - SPEC-1423
      • As discussed during F2F in Karlsruhe:
        • nbd.v3=1 (Stephane) - add boot argument to switch between old and newer implementation
        • port new nbd-client for lava-dispatcher
        • Update 2018-05-15: need to investigate uprev of nbd-client in yocto/oe before we uprev.
        • Update 2018-05-29: no update
        • Update 2018-06-12: investigating client versions
        • Update 2018-06-26: investigating client versions
        • Update 2018-07-19: investigating client versions
    • Ronan: how to avoid broken build env due to binary bsp update?
      • detect if binary driver artifacts mismatch
      • separate dummy recipe/package with no rpm (empty)
        • which does the check for the binary at configure stage.
        • e.g. at configure step.
      • Update 2018-06-12: no update
      • Update 2018-06-26: no update, plan is to do a python class.
      • Update 2018-07-18: investigating for new bsp (3.9)
    • docker container jobs fail:

Next meeting(s)

Next call in 2 weeks, same place, same time (13:00 UTC)

Meeting 2018/06/26

Attendees

Jan-Simon, Frederic, Ronan, Stephane, Liu, Oki-san

== AGL CIAT meeting ==

Topics

  • Status updates:
    • Infra:
        • Further investigation needed based on Dominigs email.
          • Need to try pxe next
        • Update 2018-06-26: Input during ALS, working sample with ipxe shown. Doc to be sent to ML.
          • Liu showed procedure
            • Advanced Network stack enabled.
            • Enable network boot in bios boot config screen (Fixed boot order)
            • build IPXE from git.ipxe.org/ipxe.git ; cd ipxe/src
            • shell.ipxe:
              • #!ipxe
              • shell
            • make bin-x86_64-efi/ipxe.efi EMBED=./shell.ipxe
          • Frederic: got pxe shell and network boot
      • download server speed issues under investigation
        • for now we doubled the speed … = ~1.5MB/s max
        • Debugging ongoing, workaround for CI WIP
        • Update 2018-06-26: Seems to be an upstream ISP issue. Workaround seems in place but no final Solution atm.
    • Lava
      • waiting for LAVA rev. 2018.04 to be ready in lava-docker
      • Means we also have to update the slaves (=new version of lava-dispatcher)
      • WIP: uprev slaves.
      • Update 2018-06-26: Schedule next week (week 27) for lab uprev.
    • KernelCI
      • webui changes WIP
        • tabs for gerrit/CI , weekly, daily, release builds
      • * Update 2018-06-26: demo last week during ALS, plan to deploy week 27
    • Fuego
      • any update ? - 2018-05-15: no updates
        • 2018-05-29: no update on lava support
        • Update 2018-06-26: Presentation during ALS with better integration (add link)
  • Current issues:
    • SPEC-1378
      • Update 2018-05-29: wip
      • Update 2018-06-12: wip
      • Update 2018-06-26: Reduce build frequency to RC's final / ondemand / move proper container to release folder.
    • New nbd client (proposal by Dominig) - SPEC-1423
      • As discussed during F2F in Karlsruhe:
        • nbd.v3=1 (Stephane) - add boot argument to switch between old and newer implementation
        • port new nbd-client for lava-dispatcher
        • Update 2018-05-15: need to investigate uprev of nbd-client in yocto/oe before we uprev.
        • Update 2018-05-29: no update
        • Update 2018-06-12: investigating client versions
        • Update 2018-06-26: investigating client versions
    • Ronan: how to avoid broken build env due to binary bsp update?
      • detect if binary driver artifacts mismatch
      • separate dummy recipe/package with no rpm (empty)
        • which does the check for the binary at configure stage.
        • e.g. at configure step.
      • Update 2018-06-12: no update
      • Update 2018-06-26: no update, plan is to do a python class.
      • Update 2018-06-26: Closed. Fix in current master.
    • docker container jobs fail:
  • New issues:
    • no

Next meeting(s)

Next call in 2 weeks, same place, same time (13:00 UTC)

Meeting 2018/05/29

Attendees

Jan-Simon,

== AGL CIAT meeting ==

Topics

  • Status updates:
    • Infra:
        • worked during f2f on netboot with uefi, need to either use grubefi or pxe .
        • Further investigation needed based on Dominigs email.
          • Need to try pxe next
      • download server speed issues under investigation
        • for now we doubled the speed … = ~1.5MB/s max
        • Ryan to does a debug session with provider
        • Debugging ongoing, workaround for CI WIP
    • Lava
    • KernelCI
      • webui changes WIP
        • tabs for gerrit/CI , weekly, daily, release builds
    • Fuego
      • any update ? - 2018-05-15: no updates
        • 2018-05-29: no update on lava support
  • Current issues:
    • SPEC-1378
      • Update 2018-05-29: wip
      • Update 2018-06-12: wip
    • New nbd client (proposal by Dominig) - SPEC-1423
      • As discussed during F2F in Karlsruhe:
        • nbd.v3=1 (Stephane) - add boot argument to switch between old and newer implementation
        • port new nbd-client for lava-dispatcher
        • Update 2018-05-15: need to investigate uprev of nbd-client in yocto/oe before we uprev.
        • Update 2018-05-29: no update
        • Update 2018-06-12: investigating client versions
    • Ronan: how to avoid broken build env due to binary bsp update?
      • detect if binary driver artifacts mismatch
      • separate dummy recipe/package with no rpm (empty)
        • which does the check for the binary at configure stage.
        • e.g. at configure step.
      • Update 2018-06-12: no update

Next meeting(s)

Next call in 2 weeks, same place, same time (13:00 UTC)

Meeting 2018/05/29

Attendees

Jan-Simon, Frederic Marec,

== AGL CIAT meeting ==

Topics

  • Current issues:
    • SPEC-1378
      • Update 2018-04-17: No update
      • EE & FF
      • Update 2018-05-15: wip, creating templates fir ci-management repo
      • Update 2018-05-29: wip
    • New nbd client (proposal by Dominig) - SPEC-1423
      • As discussed during F2F in Karlsruhe:
        • nbd.v3=1 (Stephane) - add boot argument to switch between old and newer implementation
        • port new nbd-client for lava-dispatcher
        • Update 2018-05-15: need to investigate uprev of nbd-client in yocto/oe before we uprev.
        • Update 2018-05-29: no update
    • Ronan: how to avoid broken build env due to binary bsp update?
      • detect if binary driver artifacts mismatch
      • separate dummy recipe/package with no rpm (empty)
        • which does the check for the binary at configure stage.
        • e.g. at configure step.

Next meeting(s)

Next call in 2 weeks, same place, same time (13:00 UTC)

Meeting 2018/05/15

Attendees

Jan-Simon, Frederic Marec, Liu Wenlong, Tanibata-san, Oki-san, Ronan Le Martret, Stephane Desneux, Tiejun Chen

Topics

== AGL CIAT meeting ==
  • Status updates:
    • Infra:
    • Lava
      • waiting for LAVA rev. 2018.4 to be ready in lava-docker
    • KernelCI
      • webui changes WIP
        • tabs for gerrit/CI , weekly, daily, release builds
    • Fuego
      • any update ? - 2018-05-15: no updates
  • Current issues:
    • SPEC-979 (Stephane):
      • docker images: See jira. Fixing docker build and using BUILD_NUMBER. Also separate release job for container images (other from weekly container build).
    • SPEC-1378
      • Update 2018-04-17: No update
      • EE & FF
      • Update 2018-05-15: wip, creating templates fir ci-management repo
    • New nbd client (proposal by Dominig) - SPEC-1423
      • As discussed during F2F in Karlsruhe:
        • nbd.v3=1 (Stephane) - add boot argument to switch between old and newer implementation
        • port new nbd-client for lava-dispatcher
        • Update 2018-05-15: need to investigate uprev of nbd-client in yocto/oe before we uprev.
    • m3ulcb, h3ulcb build issues in jira, Ronan is looking into it.
      • Update 2018-05-15: done
    • Ronan: how to avoid broken build env due to binary bsp update?
      • detect if binary driver artifacts mismatch
  • New issues:
    • Layer reorg in stage 3.

Next meeting(s)

Next call in 2 weeks, same place, same time (13:00 UTC)

Meeting 2018/04/17

== AGL CIAT meeting ==
  • Status updates:
    • Infra: blocked due to travel/F2F, continuing this week
  • Current issues:
    • SPEC-1374: tried to reduce build parallelism
      • Update 2018-04-17: Fixed. Was problem in cogent repo - Ronan fixed by blacklisting.
      • infra to run ptests is there
      • Update 2018-04-17: Fixed by Jose. ptests can be built again.
    • SPEC-781:
      • Missing license file checksum
      • Update 2018-04-17: Fixed. Closed.
      • install 'packer'
      • then run ./local_packer_run.sh
      • image is in 'OUTPUT' can be run in qemu
    • SPEC-979 (Stephane):
      • docker images: See jira. Fixing docker build and using BUILD_NUMBER. Also separate release job for container images (other from weekly container build).
      • Created
        • SPEC-1378
          • Update 2018-04-17: No update
        • SPEC-1379
          • Update 2018-04-17: Merged. Closed.
  • New issues:
    • New nbd client (proposal by Dominig)
    • m3ulcb, h3ulcb build issues in jira, Ronan is looking into it.
    • Ronan: how to avoid broken build env due to binary bsp update?

Next meeting(s)

Next call in 4 weeks (due to may 1st being a public holiday) same place, same time (13:00 UTC)

Meeting 2018/04/03

Attendees

Jan-Simon, Kurokawa-san, Kusakabe-san, Stephane, Oki-san, Ronan, Frederic, Liu Wenlong, Mohammed Gueroud, Vinod,

Topics

== AGL CIAT meeting ==
  • Status updates:
    • KernelCI
      • configuration in progress
    • LAVA docker in LFIT
      • setting ACL and tokens
    • CIBT / LAVA
        • Update: font package is causing the issue (Kudos to Jose)
        • Plan: make this update non-blocking for serial terminal access
        • WIP (enable KVM + fix to postinst).
        • Update 2018-04-03: KVM active in lava lab, thus mitigated.
    • Next actions: enabling more ptests and test scripts
  • New:
    • SPEC-1374: tried to reduce build parallelism
      • infra to run ptests is there,
    • SPEC-781:
      • Missing license file checksum
      • install 'packer'
      • then run ./local_packer_run.sh
      • image is in 'OUTPUT' can be run in qemu
    • SPEC-979 (Stephane):
      • docker images: See jira. Fixing docker build and using BUILD_NUMBER. Also separate release job for container images (other from weekly container build).
      • Created
        • SPEC-1378
        • SPEC-1379
        • SPEC-1380
    • New board support in FUEGO (Oki-san)
      • Introducing during F2F in Karlsuhe on Friday

Next meeting(s)

Next call in 2 weeks (apr 17th) same place, same time (13:00 UTC)

Meeting 2018/03/06

Attendees

Jan-Simon Möller, Frederic Marec

Topics

  • Status updates:
    • Infra:
      • downtime required today to re-setup firewall node in cloud env (to improve BW)
        • See email.
    • KernelCI
      • deployed
      • remaining issue: access to data older than 14d (UI)
    • LAVA docker in LFIT
      • restoring database dump
      • setting ACL and tokens
    • CIBT / LAVA
    • Lab-in-a-box
      • Training session during AMM - update/feedback ?

Next meeting(s)

Next call in 2 weeks (march 20th) same place, same time (13:00 UTC)

Meeting 2018/02/13

Attendees

Jan-Simon, Tim, Frederic, Kyohhei-san, Ronan, Kusakabe-san, Stephane

Topics

== Hosting the FUEGO meeting today, welcome! ==
  • Status update
    • Fuego status
      • next Major release areas of focus
        • Documentation conversion to reStructuredText
        • Documentation for end users (not developers)
          • How to customize tests (criteria.json)
          • Dynamic test documentation in reStructuredText
            • Combination of human-readable and Fuego-generated content
        • Fuego automated release testing (Fuego selftest)
          • ProFusion has started work
          • Have done major cleanups to Dockerfile
          • Working towards having a downloadable docker image (not requiring image build by end user)
          • work is in fuego 'next' branch of tbird20d git repository
      • System provisioning
        • Build and deploy system to target
          • Stuck working on some Board Farm management software issues
        • May add following soon:
          • board status check
          • board hardware reboot
          • board serial monitor (maybe)
      • Work is currently being done in the 'master' branch
      • A few tests changes recently:
        • added more Realtime tests: backfire, migratetest, deadlinetest
        • more changes for LTP: parsing of realtime results
== AGL CIAT meeting ==
  A start job is running for Run pending postinsts (5min 5s / no limit)[K[    [0;31m*[0;1;31m*[0m] 
  A start job is running for Run pending postinsts (5min 5s / no limit)[K[     [0;31m*[0m]
  A start job is running for Run pending postinsts (5min 6s / no limit)[K[    [0;31m*[0;1;31m*[0m] 
  A start job is running for Run pending postinsts (5min 6s / no limit)[K[   [0;31m*[0;1;31m [0m[0;31m*[0m] 
  A start job is running for Run pending postinsts (5min 7s / no limit)[K[  [0;31m*[0;1;31m*[0m[0;31m* [0m] 
  A start job is running for Run pending postinsts (5min 7s / no limit)[ 
  • Update 2018-02-13: kvm mitigates the issue, will be enabled in the labs
  • Lab-in-a-box
  • Training session during AMM
  • New:

Next meeting(s)

Need to skip call due to Embedded World. Next call in 3 & 5 weeks (march 6th and march 20th) same place, same time (13:00 UTC)

Meeting 2018/01/30

Attendees

Jan-Simon Möller, Kotaro Hasioto, Liu Wenlong, Tetsuji Yamamoto, Frederic Marec, Ronan Le Martret

Topics

  A start job is running for Run pending postinsts (5min 5s / no limit)[K[    [0;31m*[0;1;31m*[0m] 
  A start job is running for Run pending postinsts (5min 5s / no limit)[K[     [0;31m*[0m]
  A start job is running for Run pending postinsts (5min 6s / no limit)[K[    [0;31m*[0;1;31m*[0m] 
  A start job is running for Run pending postinsts (5min 6s / no limit)[K[   [0;31m*[0;1;31m [0m[0;31m*[0m] 
  A start job is running for Run pending postinsts (5min 7s / no limit)[K[  [0;31m*[0;1;31m*[0m[0;31m* [0m] 
  A start job is running for Run pending postinsts (5min 7s / no limit)[ 
  • Fuego
    • no update
  • Lab-in-a-box
    • no update
  • New topics:

Meeting 2018/01/02

Attendees

Jan-Simon Möller, Frederic Marec, Liu Wenlong, Kyohhei Oki, Ronan Le Martret, Tetsuji Yamamoto

Topics

== AGL CIAT meeting ==
  running for Run pending postinsts (5min 5s / no limit)[K[    [0;31m*[0;1;31m*[0m] A start job is running for Run pending postinsts (5min 5s / no limit)[K[     [0;31m*[0m] A start job is running for Run pending postinsts (5min 6s / no limit)[K[    [0;31m*[0;1;31m*[0m] A start job is running for Run pending postinsts (5min 6s / no limit)[K[   [0;31m*[0;1;31m*[0m[0;31m*[0m] A start job is running for Run pending postinsts (5min 7s / no limit)[K[  [0;31m*[0;1;31m*[0m[0;31m* [0m] A start job is running for Run pending postinsts (5min 7s / no limit)[ 
  • Roadmap for 2018
    • From CIAT EG
      • Lab in a box
        • Board management
        • Board on developer's desk
      • Improved publishing of test results
        • UI improvements to KCi
      • Additional tests
        • Applications
          • test output should use TAP as output format
          • work out example test for one application
        • Platform
          • ptests (embedded in the yocto recipes)
        • BSPs
          • KSelfTest
      • Fuego integration
        • Support to run tests as lava jobs (from within Fuego)
  • New:

Next meeting(s)

Call in 2 weeks same place, same time (13:00 UTC)

===


Meeting 2018/01/02

Attendees

Jan-Simon Möller, Loys Ollivier, Frederic Marec, Liu Wenlong, Ronan

Topics

== AGL CIAT meeting ==
  running for Run pending postinsts (5min 5s / no limit)[K[    [0;31m*[0;1;31m*[0m] A start job is running for Run pending postinsts (5min 5s / no limit)[K[     [0;31m*[0m] A start job is running for Run pending postinsts (5min 6s / no limit)[K[    [0;31m*[0;1;31m*[0m] A start job is running for Run pending postinsts (5min 6s / no limit)[K[   [0;31m*[0;1;31m*[0m[0;31m*[0m] A start job is running for Run pending postinsts (5min 7s / no limit)[K[  [0;31m*[0;1;31m*[0m[0;31m* [0m] A start job is running for Run pending postinsts (5min 7s / no limit)[ 

Next meeting(s)

Call in 2 weeks same place, same time (13:00 UTC) . Jan 16th 2018.

Meeting 2017/12/19

Attendees

Jan-Simon Möller, Tim Bird, Frederic Marec, Liu Wenlong, Tetsuji Yamamoto, Kotaro Hashimoto, Stephane Desneux

Topics

Fuego
== Hosting FUEGO call today - welcome ! ==
  • Release status
    • 1.2.1 release was made and announced
      • Fixups to OpenSSL, LTP, and other tests
      • added support for invoking individual phases
        • can do 'build' separate from 'run', for any test
    • next Major release areas of focus
      • Documentation conversion to reStructuredText
      • Documentation for end users (not developers)
        • How to customize tests (criteria.json)
      • Fuego automated release testing (Fuego selftest)
        • Under contract with ProFusion
      • System provisioning
        • Build and deploy system to target
    • Work is currently being done in the 'master' branch
  • Activity
  • OLD
    • Want 'test' integration with LAVA, instead of 'transport'-level integration
    • Board farm standards
      • provisioning - using libvirt, ttc, labgrid or lava
    • Fuego conversion of docs to reStructuredText
      • Conversion from Docbook and wiki Markdown to reStructuredText
      • Allow use of readthedoc.io for online
      • Build documentation from repository (move from wiki)
      • Not funded - requested to go back and see if community can perform this
    • Fuego release self-testing
      • Use Fuego to do Fuego CI testing
      • use SeleniumHQ for web interface testing
      • use 2-container system (driving container and DUT container, with next release of Fuego)
      • Funding was approved
AGL
== AGL CIAT meeting ==
  running for Run pending postinsts (5min 5s / no limit)[K[    [0;31m*[0;1;31m*[0m] A start job is running for Run pending postinsts (5min 5s / no limit)[K[     [0;31m*[0m] A start job is running for Run pending postinsts (5min 6s / no limit)[K[    [0;31m*[0;1;31m*[0m] A start job is running for Run pending postinsts (5min 6s / no limit)[K[   [0;31m*[0;1;31m*[0m[0;31m*[0m] A start job is running for Run pending postinsts (5min 7s / no limit)[K[  [0;31m*[0;1;31m*[0m[0;31m* [0m] A start job is running for Run pending postinsts (5min 7s / no limit)[ 

Next meeting(s)

Call in 2 weeks same place, same time (13:00 UTC) . Jan 2nd 2018.

Meeting 2017/11/21

Attendees

Jan-Simon Möller, Frederic Marec, Daniel Sangorrin, Yuichi Kusakabe, Sebastien Douheret, Liu Wenlong, Tetsuji Yamamoto, Stephane Desneux Ronan, Qiutingting, Kyohhei Oki, Loys Ollivier

Topics

= AGL =

  • Status updates:
    • KernelCI
    • LAVA
      • Jan-Simon:
        • Atm power outage in the core lab
        • 2017.10
    • Jenkins
      • Had the merge job being retriggered over and over. Fixed now.
      • Need to more app repos to ci-management/jjb/ci-apps (EOW)
    • Next release:
      • rc3 cut-off is 24th Nov
        • ptest
      • rc4 cut-off is 8th Dec
        • ptest
  • Open Issues:
    • Kingfisher
      • aglsetup machine template ? really needed ?
        • difference is only: kernel builds another dtb in addition
        • u-boot (usually not used)
        • additional packages pulled-in (bt firmware, …)
        • → we don't need a separate template
        • challenge: weston.ini ? runtime detect of KF ?
        • Preference 1: keep same MACHINE (aglsetup + YP)
        • Preference 2: keep same YP machine (aglsetup m3ulcb-kf + YP m3ulcb)
        • Avoid: new MACHINE in YP !
Next meeting(s)

Call in 2 weeks same place, same time (13:00 UTC) .

Meeting 2017/11/07

Attendees

Jan-Simon, Tim, Daniel, Stephane

Topics
== Hosting FUEGO call today - welcome ! First 30 minutes Fuego, 2nd 30 minutes AGL-CIAT ==

= Fuego =

  • OLD
    • Fuego status:
    • 1.2 release was made, but without announcement
      • Major features:
        • unified output format (run.json - somewhat compatible with kernelci)
        • test dependency system (NEED_xxx variables)
        • complex pass criteria handling (criteria.json)
        • chart_config.json (foundation for customizing results visualization)
        • test improvements (e.g. aarch64 support for old tests)
        • documentation fixups
      • Pending items for announcements:
        • LTP parsing of POSIX results
        • More Documentation fixups
      • Am now planning on a 1.2.1 release which includes recent bugfixes from Tim, Wenlong and Daniel
  • NEW:
    • Good discussion with Jan-Simon and Kevin Hilman about LAVA integration
      • Currently, we have “transport”-level integration
      • We need “test”-level integration
      • Kevin offered to be the contractor for this
    • Board farm/DUT control automation discussed at ELCE
    • CELP project funding
      • Discussed 4 Fuego projects:
      • LAVA integration
        • needs additional research, CELP deferred funding decision
          • Renesas wants to see justification for expense, may push funding request through AGL
      • Fuego size test
        • also needs additional research - not much interest
      • Fuego conversion of docs to reStructuredText
        • Conversion from Docbook and wiki Markdown to reStructuredText
        • Allow use of readthedoc.io for online
        • Build documentation from repository (move from wiki)
        • Not funded - requested to go back and see if community can perform this
      • Fuego release self-testing
        • Use Fuego to do Fuego CI testing
        • use SeleniumHQ for web interface testing
        • use 2-container system (driving container and DUT container, with next release of Fuego)
        • Funding was approved
        • Work to be done by ProFusion
    • Maybe add support for Jenkins pipelines?

= AGL =

  • more tests (help welcome!):
    • evaluate SPEC-272 and extend services being checked
      • need to differ between agl-image-ivi (no gfx) and agl-demo-platform (=profiles in the end)
      • e.g. check appfw with curl call
      • e.g. check kernel modules being loaded (as per our bbappends+CONFIG options)
        • can this be a macro or ptest ?
      • AMM: discuss with Jose how to appfw / application (self-)tests
  • Next
    • Discussion about time for call. Alternate time ?
      • E.g. stick with 13:00 UTC
      • Alternative time would be e.g. 16:00 UTC
      • Stick with 13:00 UTC
Next meeting(s)

Call in 2 weeks same place, same time (13:00 UTC) .

Meeting 2017/10/10

Attendees

Jan-Simon, Frederic Marec (iot.bzh), Liu Wenlong, Ronan Le Martret, Song Cai, Agustin (Codethink)

Topics

= AGL =

  • Status updates:
    • KernelCI : Setup progressing, IT working on storage backend.
    • Pyro:
      • Master now stable and we're about to do an RC1, porter still has issues with gfx.
    • SPEC-544: FIXED ! Thanks to Scott Murray, we have a patch to mitigate the problem.
      • CI confirms that the boot now works
    • more tests (help welcome!):
      • evaluate SPEC-272 and extend services being checked
        • need to differ between agl-image-ivi (no gfx) and agl-demo-platform (=profiles in the end)
        • e.g. check appfw with curl call
        • e.g. check kernel modules being loaded (as per our bbappends+CONFIG options)
          • can this be a macro or ptest ?
        • mid-sized task: can ptest's be wrapped (SPEC-758)
Next meeting(s)

Call in 4 weeks same place, same time. (Due to ELCE in Prague in 2 weeks)

Meeting 2017/09/26

Attendees

Jan-Simon, Tim, Stephane,

Topics

= AGL CIAT =

  • Status updates:
    • KernelCI instance in preparation with LFIT (ETA Thu)
    • Pyro:
      • Master works in CI, Tests fail more frequently due to SPEC-544!
      • Dab (morty) working perfectly fine
    • Test job for EE rc1 (check for the running/required services, SPEC-272, merged, Loys (baylibre)
    • Document how to add tests and use the generator/templates (c11029/Baylibre)
  • Open Round:
  • Next:
    • kCI token setup for lava.automotivelinux.org
    • SPEC-544 (serial/udev issue) (Scott/Konsulko)
    • more tests (help welcome!):
      • evaluate SPEC-272 and extend services being checked
        • need to differ between agl-image-ivi (no gfx) and agl-demo-platform (=profiles in the end)
        • e.g. check appfw with curl call
        • e.g. check kernel modules being loaded (as per our bbappends+CONFIG options)
          • can this be a macro or ptest ?
        • mid-sized task: can ptest's be wrapped (SPEC-)
    • AI: test latest Fuego with nbd patchset
Next meeting(s)

In 2 weeks

Meeting 2017/09/12

Attendees

Jan-Simon, Tim Bird, Agustin, Daniel, Liu Wenglong, Patrick Titiano, Hashimoto-san, Jerome Brunet

Topics
== Hosting FUEGO call today - welcome ! ==
  • NEW:
  • Fuego status:
    • Working towards 1.2 release
      • unified output format (run.json) - basically done
      • AGL/JTA reports - in progress (see html table work by Daniel)
      • Full LTP support - basically done, needs testing
        • Wenlong Liu and Cai Song have been testing, and submitted patches (thanks!)
      • updated wiki documentation - started
        • long-term plan: move to reStructuredText (readthedocs/sphynx)
      • LAVA integration - was deferred (had added target_setup_link/target_teardown_link)
        • Jan said I can integrate the existing pull request
        • Tim will do that
  • Broken stuff
    • Fuego plots on Jenkins pages
      • put chart processing in the parser, not mod.js (part of flot package)
      • output a flot-friendly json file (flot_chart_data.json)
      • chart_config.json
    • Fuego standalone plots
  • New Features
    • ftc gen-report (prototype, output=text for now)
    • criteria.json
    • testplan_ltsi.json
    • html tables for functional tests on Jenkins
    • results.json
  • new presentation: Integration of Fuego with Gitlab
  • plans for the future:
    • move documentation into Fuego repository (under git control)
    • have ftc gen-report output multiple formats
      • text, html, pdf, xunit, TAP)
    • year 2038 test
    • big push for new tests
      • kselftest
        • upstream kernel is converting to TAP output
      • CAN bus test
      • integrate Khiem Nguyen's test (LTSI/Renesas board test)
      • CIP tests
      • AGL tests
    • BayLibre - doing some test development for AGL (infrastructure for kernelci)
      • Also doing a test-in-a-box
  • Tim doing Linaro Connect presentation on test standards
    • pduclient
    • tguids
    • run.json (kerneci results format - with fuego stuff)
== AGL CIAT ==
  • Status updates:
    • KernelCI additions in mainline now for displaying testresults (not just boot)
    • Instance being setup by LFIT
    • Pyro:
      • Master broken in CI due to failing builds
      • Dab (morty) working perfectly fine
  • Next:
    • Planned for EOW next week KernelCI instance (LFIT)
    • Test job for EE rc1 (check for the running/required services jsmoelelr)
    • SPEC-544 (serial/udev issue) (Scott/Konsulko)
    • Document how to add tests and use the generator/templates (Kevin/Baylibre)
Next meeting(s)

In 2 weeks (2017/09/26)

Meeting 2017/08/29

Attendees

Jan-Simon, Agustin, Daniel, Hashimoto-san, Liu Wenglong, Patrick Titiano, Robert Marshall

Topics
  • Board@Desk presentation (Agustin)
  • Open round
Next meeting(s)

In 2 weeks


Meeting 2017/08/14

Attendees
Topics
== Hosting FUEGO call today - welcome ! ==
  • NEW:
    • We'll skip today's Fuego call then.
    • The next CIAT meeting is in 2 weeks.
Next meeting(s)

In 2 weeks


Meeting 2017/08/01

Attendees

Jan-Simon, Walt, Cai, Jerome, Keisuke Iwata, Liu Wenlong, Agustin

Topics
Next meeting(s)

In 2 weeks Aug 15th, 12:00 UTC (joint AGL + FUEGO)

Meeting 2017/07/18

Attendees

Jan-Simon Möller, Cai Song, Keisuke Iwata, Liu Wenlong, Stephane Desneux, Daniel Sangorrin

Topics
== First ~30 minutes - hosting FUEGO call today - welcome ! ==
  • NEW:
    • Top issues:
      1. unified json output
      2. lava integration
      3. Daniel provided kernel build test
      4. flot plugin, output refactoring is in support some new test comparison operation and reporting
    • Major feature remaining for 1.2 is the unified json output, and support for AGL reports
      1. Goal would be to release 1.2 in mid-July.
  • Unordered List Item* Unified Output Format (UOF)
    • Daniel showed format of reference.json, with new “pass-criteria”
  • Unordered List Item Tim talked about needing to share pass-criteria, and how to store and use them for a test
    • specifically alternate pass-criteria
    • Daniel showed different files for the new output format
      • schema, reference.json, run.json, results.json, and png of possible report format
      • some questions came up:
        • should the results.json (the aggregate data from multiple runs) contain the pass-criteria or reference data)?
          • it's easier to parse for the plotter without this
        • should pass-criteria be separate from the reference.json file?
        • should customized or alternate pass-criteria be stored in diff format or as full json files?
      • code to produce the html is in Daniel's next repository
    • Daniel has a new interface for generating the measurement data (parser.py)
      • parser.py builds a data structure, and calls plib.process_data to both record the data (measurements) and evaluate the pass criteria from the reference.json file
      • Tim commented that the bonnie parser.py could be simplified with a function to put operations together
        • something like: add_measure(“block.read”,“speed”,float(5))
    • More discussion of the issues will be raised on the mailing lists
  • interesting option is to use a web-based transfer to target
    • Tim started a prototype of this
    • Could transfer commands as well as test materials, using a client pull rather than host push
      • need an agent on target for this
    • eliminates the need for an ssh connection, but requires a web host (maybe can use Jenkins for this)
  • OLD - some miscellaneous technical issues
    • automatically create a view for each board (using regex of: “<board_name>.*”) (done)
    • put log links (and others) in description even if job fails (done)
    • don't require buildsetter plugin (defer)
    • automatically detect log, plot and xlsx files
      • support partial results
        • lots of times there is a test log there, even if the build failed
    • try to eliminate need for extralinks in testplan file (done - not there anymore)
  • eliminate need for timeout in testplan file (not needed, if default is used)
    • do a better job of automatically calculating timeouts
    • this is dependent on test, spec, board and other parameter
  • NEW:
    • a
    • b
== AGL-CIAT Meeting: ==
  • OLD topics:
    • Related issue: device_type names in lava need to be converted to match DTB name
      • Update 04/07: In preparation
      • Update 18/07: ETA this week to cut-over all labs
    • Stephane: weston startup to be worked on. Also looks into virtual screens for simulation purposes (e.g. including faking EDIDs). Tests must be independent of the compositor going forward.
    • SPEC-495 - Template for apps (cmake, tbd. qmake, fallback Makefile)
      • Autobuild script for CI:
        • qmake needed for current demo apps
        • requirements: git clone (or git submodule) , clone and calling of script will build app with autodetected method (qmake, cmake, autotools, Makefile)
        • app templates usable as git submodules (atm: cmake)
        • Workflow:
          • clone (recursive)
          • autobuild && conf.d/autobuild/agl/autobuild package DEST=$(pwd)/package/ (pickup is package/*.wgt)
          • + generic procedure (call make as fallback)
        • new JIRA for qmake macros
      • Update 20/06: Templates enhanced, no Autobuild for CI, yet
      • Update 18/07: Changesets merged in gerrit, doc pending, qmake pending
  • NEW topics:
    • a
Next meeting(s)

In 2 weeks Aug 1st, 12:00 UTC


Meeting 2017/07/04

Attendees

Jan-Simon, Daniel, Iwata-san, Hashimoto-san, Liu Wenlong, Oki-san, Stephane, Agustin

Topics
  • OLD topics:
    • Hardware test template for gen3
      • Update 04/07: Added, activation changeset pendinng in gerrit
    • Related issue: device_type names in lava need to be converted to match DTB name
      • Update 04/07: In preparation
    • Stephane: weston startup to be worked on. Also looks into virtual screens for simulation purposes (e.g. including faking EDIDs). Tests must be independent of the compositor going forward.
    • SPEC-495 - Template for apps (cmake, tbd. qmake, fallback Makefile)
      • add optional script there, bbclass add generic script if no script is there.
      • yocto SDK installs too-much debug-packages (e.g. from platform)
      • Autobuild script for CI:
        • qmake needed for current demo apps
        • requirements: git clone (or git submodule) , clone and calling of script will build app with autodetected method (qmake, cmake, autotools, Makefile)
      • Update 20/06: Templates enhanced, no Autobuild for CI, yet
        • app templates usable as git submodules (atm: cmake)
        • Workflow:
          • clone (recursive)
          • autobuild && conf.d/autobuild/agl/autobuild package DEST=$(pwd)/package/ (pickup is package/*.wgt)
          • + generic procedure (call make as fallback)
        • new JIRA for qmake macros
Next meeting(s)

In 2 weeks July 18th, 12:00 UTC (joint AGL + FUEGO)


Meeting 2017/06/20

Attendees
Topics
== First ~30 minutes - hosting FUEGO call today - welcome ! ==
  • OLD:
    • a
  • NEW:
    • b
== 2nd ~30 minutes - hosting AGL CIAT call today - welcome ! ==
Next meeting(s)

In 2 weeks … but Independency Day in US July 4th, 12:00 UTC


Meeting 2017/06/13

Attendees

Jan-Simon, Walt, Michael, Agustin, Cai Song, Daniel, Liu Wenlong, Stephane Desneux, Matsuzawa-san, Ronan Le Martret, Kyohhei Oki,

Topics
Next meeting(s)

next week (+ fuego) June 20, 12:00 UTC


Meeting 2017/05/23

Attendees

Jan-Simon, Walt Miner, Harunobu Kurokawa, Liu Wenlong, Patrick Titiano, Takahi Matsuzawa, Tim Bird, Cai Song, Kyohhei Oki , Agustin Benito Bethencourt

Topics
== First ~30 minutes - hosting FUEGO call today - welcome ! ==
  • OLD:
    • Top issues:
      1. unified json output
        1. patch for functional tests produce a results.json file
        2. discussion on the kernelci results schema (on the fuego mailing list)
          1. Kevin Hillman started discussion - Daniel responded
          2. Daniel added some fields to the run.json (don't know if that's related to discussion)
          3. Lots of work already done in kernelci - should reuse their expertise (if in doubt)
          4. Will probably err on the side of too much info
            1. contact xxx for discussion of fields and schema used by kernelci
        3. Song said that they are working on LTP as higher priority
      2. lava integration
        1. ov_transport_connect/disconnect is goal
          1. have added TARGET_TEARDOWN_LINK
        2. shorter connection times
          1. refactored connection/disconnection location in pre_test and post_test
        3. standalone build phase
          1. prototype with LTP (build_only)
            1. specialized solution - would like a more general one
              1. maybe something like rpm phase selection
        4. Would like to execute jobs in batch job in the same order as the testplan
          1. this would support having a “board setup” job at the beginning of a sequence of jobs
        5. unify the test types
          1. gotten rid of distinction between functional and benchmark tests
            1. main.sh
              1. every test, whether Functional or Benchmark, now uses 'fuego_test.sh' as the base script name.
      3. Daniel provided kernel build test
        1. added support for git repository checkout and build
        2. Has a patch in-flight that does kselftest
      4. flot plugin, output refactoring is in support some new test comparison operation and reporting
        1. goal is to support previous JTA use cases and ALG-JTA use cases for reporting in 1.2 release
    1. Testing BOF at ALS, June 2, 2:00 pm
    2. Tentative plan private meeting at ALS, on May 31, at 10:00 am.
    3. Major feature remaining for 1.2 is the unified json output, and support for AGL reports
      1. Goal would be to release 1.2 in mid-July.
  • status of toshiba/sony merge
    • made the 1.1 release (“blaze”)
  • resolving technical issues with Tim's 'next' branch (based on Daniel's 'next' branch) (done)
  • priority list for AGL, to start that merge
    • LAVA integration
  • is 'uniform test output' a high-priority feature? (yes)
  • interesting option is to use a web-based transfer to target
    • Tim started a prototype of this
    • Could transfer commands as well as test materials, using a client pull rather than host push
      • need an agent on target for this
    • eliminates the need for an ssh connection, but requires a web host (maybe can use Jenkins for this)
  • planning for an official fuego release (done)
    • 1.1.0 release, code name: blaze
  • some miscellaneous technical issues
    • TESTNAME (base script name) is derived from the test name (<prefix>.testname)
    • use of spec name in job name, instead of plan name (done)
    • add node and job scripts to ftc (done)
    • eliminate fuego-ro/scripts (done)
    • move /fuego-ro/conf/boards to /fuego-ro/boards (done)
    • AGL has lava scripts in /fuego-ro, and some board-related stuff
      • in boards, auth files for LAVA
      • in fuego-ro/scripts - 2 scripts (for link setup and teardown)
        • defer looking at this right now
    • automatically create a view for each board (using regex of: “<board_name>.*”) (done)
    • put log links (and others) in description even if job fails (done)
    • don't require buildsetter plugin (defer)
    • automatically detect log, plot and xlsx files
      • support partial results
        • lots of times there is a test log there, even if the build failed
    • try to eliminate need for extralinks in testplan file (done - not there anymore)
  • eliminate need for timeout in testplan file (not needed, if default is used)
    • do a better job of automatically calculating timeouts
    • this is dependent on test, spec, board and other parameter
  • NEW:
== AGL-CIAT Meeting: ==
Next meeting(s)

June 6, 12:00 UTC


Meeting Archive

Meeting 2016/yy/zz

Attendees
Topics
Notes
Goals for next 2 weeks
Next meeting

eg-ciat/meetings.1531225985.txt.gz · Last modified: 2018/07/10 12:33 by jsmoeller