From Fedora Project Wiki

(Attendees and Travel Details: Add abompard)
m
 
(46 intermediate revisions by 11 users not shown)
Line 1: Line 1:
 
This is the main page for a CI and Infrastructure hackathon 2017. This hackathon is intended to help the team leap ahead for several critical Fedora initiatives.
 
This is the main page for a CI and Infrastructure hackathon 2017. This hackathon is intended to help the team leap ahead for several critical Fedora initiatives.
 +
 +
== Working Session Notes ==
 +
 +
There is a [[Gobby]] Doc named '''CI-Infrastructure-Hackathon-2017''' where notes will be kept about the working session.
 +
 +
=== Output and outcomes ===
 +
 +
* [https://blog.electronsweatshop.com/2017-ci-and-infrastructure-hackathon.html Randy Barlow's blog entry]
 +
 +
* [https://www.scrye.com/wordpress/nirik/2017/05/15/ci-and-infrastructure-hackfest-2017/ Kevin Fenzi's blog entry]
 +
 +
* [https://www.jcline.org/blog/fedora/2017/05/18/ci-and-infrastructure-hackathon-2017.html Jeremy Cline's blog entry]
  
 
== Purpose ==
 
== Purpose ==
 
Our purpose is to complete the following '''primary''' goals:
 
Our purpose is to complete the following '''primary''' goals:
# Continue and/or complete key CI pipeline implementation
+
# Expand skills/knowledge of authorization/authentication systems in Fedora -- ''(max 1 day)''
#* ''This goal will be further outlined based on discussions between now and the event.''
 
# Expand skills/knowledge of authorization/authentication systems in Fedora
 
 
#* All core sysadmin team members will understand FreeIPA/Ipsilon backend administration tasks and ensure they are documented in [http://fedora-infra-docs.readthedocs.io/en/latest/sysadmin-guide/index.html the Fedora Infra Sysadmin Guide]
 
#* All core sysadmin team members will understand FreeIPA/Ipsilon backend administration tasks and ensure they are documented in [http://fedora-infra-docs.readthedocs.io/en/latest/sysadmin-guide/index.html the Fedora Infra Sysadmin Guide]
 
#* Key developers will understand changes needed in current apps and best practices for new ones, if applicable, and capture them in [http://fedora-infra-docs.readthedocs.io/en/latest/dev-guide/index.html the Fedora Infra Developer Guide]
 
#* Key developers will understand changes needed in current apps and best practices for new ones, if applicable, and capture them in [http://fedora-infra-docs.readthedocs.io/en/latest/dev-guide/index.html the Fedora Infra Developer Guide]
# Establish an OpenShift instance in Fedora infrastructure
+
# Continue and/or complete key CI pipeline implementation -- ''(est. 2 days)''
 +
#* ''This goal will be further outlined based on discussions between now and the event.''
 +
#** Work with Mike McLean a roadmap to bring CI support to koji
 +
#** Work with Mike McLean a roadmap to set up a dev environment for koji for future contribution
 +
#** Start working with Mike McLean to bring CI support to koji
 +
#** Work to bring a gating mechanism to Bodhi
 +
# Establish an OpenShift instance in Fedora infrastructure -- ''(est. 2 days)''
 
#* Determine the extent to which OpenShift can be expanded beyond [https://copr.fedorainfracloud.org/coprs/maxamillion/atomic-reactor/ OSBS]
 
#* Determine the extent to which OpenShift can be expanded beyond [https://copr.fedorainfracloud.org/coprs/maxamillion/atomic-reactor/ OSBS]
 
#* Determine policy and workflows and what might fit in and what will stay out  
 
#* Determine policy and workflows and what might fit in and what will stay out  
Line 18: Line 34:
 
== Detailed Work Items & Final Attendees ==
 
== Detailed Work Items & Final Attendees ==
  
=== Priorities ===
+
=== Deliverables ===
  
{|
+
{| class="table"
! Priorities: ((AuthN/AuthZ)) !! Task Owner !! Done  
+
! Deliverables: ((AuthN/AuthZ)) !! Task Owner !! Done  
 +
|-
 +
| <strike>Build documentation for OIDC best practices in our apps</strike> Create social auth SOP || puiterwijk, jcline || {{check}}
 +
|-
 +
! Deliverables: ((CI Pipeline)) !! Task Owner !! Done
 +
|-
 +
| Roadmap for CI support in Koji || pingou, mikem || {{check}}
 +
|-
 +
| Adjust bodhi for CI: DB change, UI and API (internal or not) / Gating mechanism in Bodhi || bowlofeggs, pingou || {{check}}
 
|-
 
|-
| || ||
+
| Find a solution and make a roadmap for the mapping between test results and bodhi updates || tflink, bowlofeggs, pingou || {{check}}
 
|-
 
|-
! Priorities: ((CI Pipeline)) !! Task Owner !! Done
+
| Get ci.centos.org to speak on the staging fedmsg bus || bstinson, puiterwijk || {{check}}
 
|-
 
|-
| || ||
+
| Investigate making Bodhi mashing more "continuous" while continuing to mirror sync once per day || bowlofeggs, dustymabe || {{check}}
 
|-
 
|-
! Priorities: ((OpenShift)) !! Task Owner !! Done
+
! Deliverables: ((OpenShift)) !! Task Owner !! Done
 
|-
 
|-
| || ||
+
| Discover and record answers to all the questions on [[Infrastructure/OpenShift]] and establish roadmap || kfenzi, ssmoogen || {{check}}
 
|-
 
|-
 +
| OpenShift deployed in staging infrastructure || puiterwijk, maxamillion || {{check}}
 
|}
 
|}
  
=== Deliverables ===
+
=== Follow-up tickets ===
  
{|
+
{| class="table"
! AuthN/AuthZ !! Task Owner !! Done
+
! Follow-up: !! Ticket
 +
|-
 +
| Adjust ExecDB to be more independent from buildbot so it is easier to use for CI || [https://phab.qa.fedoraproject.org/D1150 https://phab.qa.fedoraproject.org/D1150]
 
|-
 
|-
| || ||
+
| fedmsg-client listening to test results to adjust existing bodhi update || [https://github.com/fedora-infra/bodhi/issues/1513 https://github.com/fedora-infra/bodhi/issues/1513]
 +
|-
 +
| fedmsg-client listening to new bodhi update and adjust tweak their CI status if test results are already known || [https://github.com/fedora-infra/bodhi/issues/1514 https://github.com/fedora-infra/bodhi/issues/1514]
 +
|-
 +
| fedmsg-client listening to CI message to update execdb and resultsdb ||
 +
|-
 +
| Vagrant-based koji dev environment ||
 +
|-
 +
| Store in Bodhi the hash of the commit a build originated from || [https://github.com/fedora-infra/bodhi/issues/1512 https://github.com/fedora-infra/bodhi/issues/1512]
 +
|-
 +
| Cron job to update the CI status for updates missing it || [https://github.com/fedora-infra/bodhi/issues/1515 https://github.com/fedora-infra/bodhi/issues/1515]
 +
|-
 +
| Get the [https://fedoraproject.org/wiki/Infrastructure/Factory2/Focus/Greenwave GreenWave project] up and running ||
 +
|-
 +
| Document the procedure to debug/fix requests from users about askbot's social auth feature || [https://pagure.io/fedora-infrastructure/issue/6056 https://pagure.io/fedora-infrastructure/issue/6056]
 
|-
 
|-
| More to come... ||  ||
 
 
|}
 
|}
  
 
=== Attendees and Travel Details ===
 
=== Attendees and Travel Details ===
{|
+
{| class="table"
 
! Contributor !! Arrival !! Departure !! Roommate !! Notes
 
! Contributor !! Arrival !! Departure !! Roommate !! Notes
 
|-
 
|-
| Patrick Uiterwijk || || ||  ||  
+
| Patrick Uiterwijk || Sun May 7th, 3:32pm (Flight: KL6772) || Fri May 12th, 7:59pm (Flight KL7294) ||  Kevin F ||  
 
|-
 
|-
| Kevin Fenzi || || || ||  
+
| Kevin Fenzi || Sun May 7th, 4:05pm (Flight: southwest 612) || Fri May 12th, 6:40pm (Flight southwest 3119) || Patrick U ||  
 
|-
 
|-
| Pierre-Yves Chibon || || || ||  
+
| Pierre-Yves Chibon || Sun May 7th, 2:12pm (Flight: AF3582) || Fri May 12th, 5:15pm (Flight AF8547) || tflink ||  
 
|-
 
|-
| [[User:Maxamillion | Adam Miller]] || || || ||  
+
| [[User:Maxamillion | Adam Miller]] || Sun May 7th, 10:10pm (American Airlines 1207) || Saturday May 13th, 11:39am (American Airlines 2212) || Paul F ||  
 
|-
 
|-
 
| [[User:bowlofeggs | Randy Barlow]] || -∞ || ∞ ||  ||  
 
| [[User:bowlofeggs | Randy Barlow]] || -∞ || ∞ ||  ||  
Line 63: Line 103:
 
| Stephen Smoogen || -∞ || ∞ ||  ||  
 
| Stephen Smoogen || -∞ || ∞ ||  ||  
 
|-
 
|-
| Kushal Das || || ||   ||  
+
| Brian Stinson || 2017-05-05 @ 12:20 (Flight: AA3736) || 2017-05-12 @ 11:39 (Flight: AA2212) || relrod? ||  
 
|-
 
|-
| Brian Stinson || || || ||  
+
| Tim Flink? || 2017-05-07 @ 15:17 (Flight: United UA294) || 2017-05-12 @ 15:55 (Flight: United UA1910) || pingou ||
 
|-
 
|-
| Tim Flink? || || || ||  
+
| Ricky Elrod || ||Friday, 7:10pm flight || ||
 
|-
 
|-
| [[User:pfrields | Paul Frields]] || || || || (unsure of stay length)
+
| [[User:pfrields | Paul Frields]] || (driving, TBD) || (driving, TBD) || Adam M ||  
 
|-
 
|-
 
|  ||  ||  ||  ||  
 
|  ||  ||  ||  ||  
Line 78: Line 118:
 
|-
 
|-
 
|  ||  ||  ||  ||
 
|  ||  ||  ||  ||
 +
|-
 +
! colspan=5 | Lurkers
 +
|-
 +
| Ralph Bean ||  ||  ||  ||
 +
|-
 +
| Matt Prahl ||  ||  ||  ||
 +
|-
 +
| Mike Bonnet ||  ||  ||  ||
 
|}
 
|}
  
Line 96: Line 144:
 
# '''Location:''' Red Hat, Raleigh NC, USA
 
# '''Location:''' Red Hat, Raleigh NC, USA
 
#* Red Hat Tower, 9th Floor South, "Fedora" room
 
#* Red Hat Tower, 9th Floor South, "Fedora" room
 +
#* Lodging: Courtyard Raleigh Midtown -- 1041 Wake Town Dr, Raleigh, NC 27609 -- ph (919) 821-3400 -- Red Hat rate $139 + taxes
 
# '''Date:''' 2017-May-08 to 2017-May-12
 
# '''Date:''' 2017-May-08 to 2017-May-12
 
#* Visitors should arrive on Sunday May 7th if possible
 
#* Visitors should arrive on Sunday May 7th if possible
Line 106: Line 155:
 
== Logistics ==
 
== Logistics ==
 
'''Snacks/Beverages:''' Can be snarfed from Raleigh office
 
'''Snacks/Beverages:''' Can be snarfed from Raleigh office
 
'''Breakfast:'''
 
* Covered at hotel
 
 
'''Lunch:'''
 
* ...
 
 
'''Dinner:'''
 
* ...
 
 
'''Total food: est. $'''
 
  
 
== Travel estimates ==
 
== Travel estimates ==
  
{|
+
{| class="table"
 
! Contributor !! Taxi/transport (to/from home) !! Airfare !! Taxi/transport (to/from site) !! Parking !! Other  
 
! Contributor !! Taxi/transport (to/from home) !! Airfare !! Taxi/transport (to/from site) !! Parking !! Other  
 
|-
 
|-
| pingou || ~USD200 (home <-> Paris)  || KLM: ~USD1300 ||  ||  ||
+
| [[User:pingou | Pierre-Yves Chibon]] || ~142€ (home <-> Paris)  || AF: ~1182€ ||  ||  ||
 
|-
 
|-
 
| [[User:Maxamillion | Adam Miller]] || N/A || American: ~$450 || ~$50 || $105 ||
 
| [[User:Maxamillion | Adam Miller]] || N/A || American: ~$450 || ~$50 || $105 ||
Line 131: Line 169:
 
| [[User:Kevin | Kevin Fenzi]] || $40 || Southwest: ~420 || || ||
 
| [[User:Kevin | Kevin Fenzi]] || $40 || Southwest: ~420 || || ||
 
|-
 
|-
| [[User:puiterwijk | Patrick Uiterwijk]] || $0 || KLM: ~1400USD || || ||
+
| [[User:puiterwijk | Patrick Uiterwijk]] || $0 || KLM: $1400 || || ||
 +
|-
 +
| [[User:Tflink| Tim Flink]] || $30 || United: ~$400 || $50 || 50 || ''flight covered by Tim's travel budget''
 
|-
 
|-
| [[User:Tflink| Tim Flink]] || $30 || United: ~$400 || $50 || 50 ||
+
| [[User:Codeblock | Ricky Elrod]] || $20 || American ~$300 || || ~$60 ||
 
|-
 
|-
| ||  ||  ||  ||  ||
+
| [[User:Bstinson | Brian Stinson]] ||  ||  ||  ||  || ''Covered by Brian's travel budget''
 
|-
 
|-
 +
| [[User:Kushal | Kushal Das]] ||  || $600 ||  ||  || ''Note: side trip from PDX''
 
|}
 
|}
  
# '''Travel:''' $$
+
# '''Travel:''' $5900 (est)
 
# '''Housing:''' - $3200 (est)
 
# '''Housing:''' - $3200 (est)
#* Sheraton or Marriott nearby
+
#* Courtyard Raleigh Midtown -- 1041 Wake Town Dr, Raleigh, NC 27609 -- ph (919) 821-3400 -- Red Hat rate $139 + taxes
 
#* Possibility of 1-2 people being housed locally?
 
#* Possibility of 1-2 people being housed locally?
 
# '''Space:'''
 
# '''Space:'''
Line 147: Line 188:
 
# '''Supplies:'''
 
# '''Supplies:'''
 
#* N/A
 
#* N/A
# '''Food:''' $$
+
# '''Food:''' $600 (est -- to be paid by Fedora Engineering budget)
  
''Total budget:  $$''
+
''Total budget:  $9100 estimated
  
  
 
[[Category:FAD]]
 
[[Category:FAD]]

Latest revision as of 18:04, 9 June 2018

This is the main page for a CI and Infrastructure hackathon 2017. This hackathon is intended to help the team leap ahead for several critical Fedora initiatives.

Working Session Notes

There is a Gobby Doc named CI-Infrastructure-Hackathon-2017 where notes will be kept about the working session.

Output and outcomes

Purpose

Our purpose is to complete the following primary goals:

  1. Expand skills/knowledge of authorization/authentication systems in Fedora -- (max 1 day)
    • All core sysadmin team members will understand FreeIPA/Ipsilon backend administration tasks and ensure they are documented in the Fedora Infra Sysadmin Guide
    • Key developers will understand changes needed in current apps and best practices for new ones, if applicable, and capture them in the Fedora Infra Developer Guide
  2. Continue and/or complete key CI pipeline implementation -- (est. 2 days)
    • This goal will be further outlined based on discussions between now and the event.
      • Work with Mike McLean a roadmap to bring CI support to koji
      • Work with Mike McLean a roadmap to set up a dev environment for koji for future contribution
      • Start working with Mike McLean to bring CI support to koji
      • Work to bring a gating mechanism to Bodhi
  3. Establish an OpenShift instance in Fedora infrastructure -- (est. 2 days)
    • Determine the extent to which OpenShift can be expanded beyond OSBS
    • Determine policy and workflows and what might fit in and what will stay out
      • Application development
      • Application deployment
      • Upstream collaboration with Factory 2.0
    • Develop necessary playbooks, etc. to deploy

Detailed Work Items & Final Attendees

Deliverables

Deliverables: ((AuthN/AuthZ)) Task Owner Done
Build documentation for OIDC best practices in our apps Create social auth SOP puiterwijk, jcline Checkmark.png
Deliverables: ((CI Pipeline)) Task Owner Done
Roadmap for CI support in Koji pingou, mikem Checkmark.png
Adjust bodhi for CI: DB change, UI and API (internal or not) / Gating mechanism in Bodhi bowlofeggs, pingou Checkmark.png
Find a solution and make a roadmap for the mapping between test results and bodhi updates tflink, bowlofeggs, pingou Checkmark.png
Get ci.centos.org to speak on the staging fedmsg bus bstinson, puiterwijk Checkmark.png
Investigate making Bodhi mashing more "continuous" while continuing to mirror sync once per day bowlofeggs, dustymabe Checkmark.png
Deliverables: ((OpenShift)) Task Owner Done
Discover and record answers to all the questions on Infrastructure/OpenShift and establish roadmap kfenzi, ssmoogen Checkmark.png
OpenShift deployed in staging infrastructure puiterwijk, maxamillion Checkmark.png

Follow-up tickets

Follow-up: Ticket
Adjust ExecDB to be more independent from buildbot so it is easier to use for CI https://phab.qa.fedoraproject.org/D1150
fedmsg-client listening to test results to adjust existing bodhi update https://github.com/fedora-infra/bodhi/issues/1513
fedmsg-client listening to new bodhi update and adjust tweak their CI status if test results are already known https://github.com/fedora-infra/bodhi/issues/1514
fedmsg-client listening to CI message to update execdb and resultsdb
Vagrant-based koji dev environment
Store in Bodhi the hash of the commit a build originated from https://github.com/fedora-infra/bodhi/issues/1512
Cron job to update the CI status for updates missing it https://github.com/fedora-infra/bodhi/issues/1515
Get the GreenWave project up and running
Document the procedure to debug/fix requests from users about askbot's social auth feature https://pagure.io/fedora-infrastructure/issue/6056

Attendees and Travel Details

Contributor Arrival Departure Roommate Notes
Patrick Uiterwijk Sun May 7th, 3:32pm (Flight: KL6772) Fri May 12th, 7:59pm (Flight KL7294) Kevin F
Kevin Fenzi Sun May 7th, 4:05pm (Flight: southwest 612) Fri May 12th, 6:40pm (Flight southwest 3119) Patrick U
Pierre-Yves Chibon Sun May 7th, 2:12pm (Flight: AF3582) Fri May 12th, 5:15pm (Flight AF8547) tflink
Adam Miller Sun May 7th, 10:10pm (American Airlines 1207) Saturday May 13th, 11:39am (American Airlines 2212) Paul F
Randy Barlow -∞
Jeremy Cline -∞
Stephen Smoogen -∞
Brian Stinson 2017-05-05 @ 12:20 (Flight: AA3736) 2017-05-12 @ 11:39 (Flight: AA2212) relrod?
Tim Flink? 2017-05-07 @ 15:17 (Flight: United UA294) 2017-05-12 @ 15:55 (Flight: United UA1910) pingou
Ricky Elrod Friday, 7:10pm flight
Paul Frields (driving, TBD) (driving, TBD) Adam M
Remote attendees
Aurélien Bompard
Lurkers
Ralph Bean
Matt Prahl
Mike Bonnet

Planning Prerequisites

See the How to organize a FAD list; you can keep your to-do list here.

  • Work out budget
  • Decide on Dates and Location
  • Arrange Facilities
  • List Resources
  • Be Somewhat Structured
  • Arrange Lodging
  • Arrange Refreshments
  • Arrange a Social Event -- N/A

Plan

  1. Location: Red Hat, Raleigh NC, USA
    • Red Hat Tower, 9th Floor South, "Fedora" room
    • Lodging: Courtyard Raleigh Midtown -- 1041 Wake Town Dr, Raleigh, NC 27609 -- ph (919) 821-3400 -- Red Hat rate $139 + taxes
  2. Date: 2017-May-08 to 2017-May-12
    • Visitors should arrive on Sunday May 7th if possible
  3. Remote Attendees: (include dial-in)
  4. Schedule
    • Event starts 9:30am daily
    • Event ends by noon Friday May 12th, to allow for travel outbound
    • ...

Logistics

Snacks/Beverages: Can be snarfed from Raleigh office

Travel estimates

Contributor Taxi/transport (to/from home) Airfare Taxi/transport (to/from site) Parking Other
Pierre-Yves Chibon ~142€ (home <-> Paris) AF: ~1182€
Adam Miller N/A American: ~$450 ~$50 $105
Jeremy Cline $0 $0 $0 $0
Kevin Fenzi $40 Southwest: ~420
Patrick Uiterwijk $0 KLM: $1400
Tim Flink $30 United: ~$400 $50 50 flight covered by Tim's travel budget
Ricky Elrod $20 American ~$300 ~$60
Brian Stinson Covered by Brian's travel budget
Kushal Das $600 Note: side trip from PDX
  1. Travel: $5900 (est)
  2. Housing: - $3200 (est)
    • Courtyard Raleigh Midtown -- 1041 Wake Town Dr, Raleigh, NC 27609 -- ph (919) 821-3400 -- Red Hat rate $139 + taxes
    • Possibility of 1-2 people being housed locally?
  3. Space:
    • $0 -- Supplied by Red Hat
  4. Supplies:
    • N/A
  5. Food: $600 (est -- to be paid by Fedora Engineering budget)

Total budget: $9100 estimated