Fork me on GitHub
#ask-the-speaker-plenary
<
2020-10-16
>
Topo pal00:10:00

Chuck Norris

Rajat Sud (DevOps Evangelist, CareFirst BCBSA)00:10:04

@biswanath.basu @jennifer.hansen, were you able to correlate the success in your metrics to an improved NPS as well?

inactive00:10:21

Thank you, @jennifer.hansen, @rakesh.goyal and @biswanath.basu!!

3
👏 8
upvotepartyparrot 1
Biswanath Basu00:10:57

Many thanks Gene and everyone for inviting us:pray:

Misty (American Airlines)00:10:37

Did this hit home just a little?! 🙂

Venkata L - American Airlines00:10:06

yes, I am curious to know how long their journey took.

Rakesh Goyal00:10:10

this was in total ~3 years journey

Venkata L - American Airlines00:10:17

@rakesh.goyal -that's an amazing Journey from COTS product to cloud & DevOps

💯 1
Rakesh Goyal00:10:16

Yes. It was hard to envision up front the entire journey. I have learned over the years, there needs to be a belief in the journey and you can find your way to the goals. Many hurdles come up however, if you know going forward is the only option then you always find a way. Either engineering and many times even how you envision the product itself!

Misty (American Airlines)00:10:35

@rakesh.goyal We're starting a migration off a 47 year old mainframe that's FAA certified! 😧 Thanks for inspiring us for our journey!

Rakesh Goyal00:10:29

Really small releases to learn is important! There is no release too small.

👍 2
inactive00:10:11

Please welcome @eileencodes!!

👋 1
Rakesh Goyal00:10:19

Thanks for the opportunity to share our story!

inactive00:10:18

OMG. Laughing at my own joke: “I don’t like to upgrade, because when I do, everything breaks.” 🙂

6
Istvan Bathazi00:10:45

probably getting tired... you might need a drink 🍷

Istvan Bathazi00:10:57

i saw there is an unofficial happy hour already organized 🙂

Andrew Davis - Copado - DevOps for Salesforce00:10:35

@eileencodes the description of your session sounds like a warning against pressing that "Fork" button that GitHub makes so attractive looking

Philip Day00:10:43

Fantastic talk thanks (Capital One)! For me the success story there is based in the management attitudes: • Engineering is customer-centric and pro-collaboratoin (esp Ops & Agents) • Business and compliance sides understood engineering need for continuous flow Everything else follows.

Andy Nelson, Product Mgr - CH Robinson00:10:53

Hi! @eileencodes - Looking forward to it!

❤️ 1
inactive00:10:31

“We forked Rails and practically made our own version.” (circa Rails 2, I think.)

😮 2
Jeffrey Fredrick, Author-Agile Conversations00:10:33

same applies to test frameworks. always extract test framework from real tests.

inactive00:10:06

PS: I still remember watching the famous DHH 15m Rails video, and how it blew my mind. I even called up a friend, and made him watch it with me. While I was on the phone. (Actually, that’s a very similar reaction I had when I saw the video of @eileencodes presenting at RailsConf last year!!! I started sending texts to @stephen within minutes!! 🙂

Nick Eggleston (Nix) - IT Architect - (actively looking)00:10:32

Ruby on Rails is a fun language/framework... the GIL however was not fun...

💯 1
inactive00:10:49

“GitHub Rails soon morphed into a parallel fork” — presumably, increasingly distant from what the rest of the universe was using.

Nick Eggleston (Nix) - IT Architect - (actively looking)00:10:23

Compounding technical debt as time progressed...

Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:00

this is so true, the longer you let the tech debt fester the worst it'll be

inactive00:10:56

“two years into the Rails 3 upgrade, engineers started wondering whether it was worth it after all.” 😂😂😂 (oh, it hurts!!)

🤕 2
Jeffrey Fredrick, Author-Agile Conversations00:10:24

hard to change when you’re not feeling the pain. < one of the discussion topics at the “changing behavior” lean coffee

💯 1
inactive00:10:48

“it became increasingly difficult to separate the application and the infrastructure” 😂

James Simon, FCA, Solution Architect00:10:19

Yeah usually if you are doing the wrong thing and feeling no pain, it is because it is doing push ups to hit you harder

😂 2
inactive00:10:26

“can’t Google anything” 😂😂. (I told @eileencodes that in 2006, I had to write circa 2003 RSpec tests, and literally couldn’t find any docs on how to do it!)

Dominic Laycock00:10:31

This is such a familiar story for (I presume) anyone that has built an application on top a framework

Andrew Davis - Copado - DevOps for Salesforce00:10:46

Advocates of time machines and parallel universes take note: Forking reality is just not worth the engineering effort.

Daniel Cahill - Engineer - Ontario Systems00:10:48

Was there a specific point in time that convinced you it was time to figure out how to close the fork?

Eileen Uchitelle - eileencodes - GitHub - Principal Software Engineer00:10:37

I think I banned adding to the fork at 4.1 so that we could get off the fork. I closed it on 5.0.

👍 1
inactive00:10:24

A friend told me how it felt that they were still trying to upgrade to Rails 4…. “and then Rails 5 came out” 😂😂😂

Frotz Faatuai (Cisco IT - he/him)00:10:44

“When do you feel the pain of an upgrade?” • My old team (which I joined in 2006) was tied to OO-Perl and on 5.6.1 for 14 years. • We pushed through a 5.14 upgrade which ran through to the platform decomm which started 4 years ago (we’re still waiting for the last application to be transformed). • 22 years. • So hard to get away from “fork” decisions.

inactive00:10:00

“It was one of the most difficult things I’ve ever done; required focus, determination…“. 🙏🙏

Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:02

"Upgrades are thankless feats of strength", this is sooo true

🙏 2
Eduardo Rodrigues Semensati (Procter and Gamble)00:10:08

it looks like a SAP ERP upgrade, when you are finally done, the new version comes out 😄

James Simon, FCA, Solution Architect00:10:18

In a micro cosm of this right now, with GH Enterprise. A network error blocked upgrades, we are so far behind now, my boss is afraid of starting

Jeffrey Fredrick, Author-Agile Conversations00:10:29

“the first time in 10 year”

inactive00:10:37

“it had been ten years since GitHub ran on a current version of Rails!” (!!!)

🤯 5
Topo pal00:10:45

10 years of technical debt!!!!

Bryan Finster - Walmart (Speaker)00:10:51

Isn't it funny how "we" are always smarter than "them"?

😂 2
Jeffrey Fredrick, Author-Agile Conversations00:10:57

(😆 when we make the same comments)

Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:25

I mean it's suuuch a great story, the longer you delay the upgrade the more it's going to cost you later on to do it

💯 1
Nick Eggleston (Nix) - IT Architect - (actively looking)00:10:32

Staying up to date is painful, but not doing it will be multiples worse

Frotz Faatuai (Cisco IT - he/him)00:10:36

Calling out that cost is hugely important! So hard to fight against the most recent quarter’s MVP delivery value…

💯 1
inactive00:10:46

@eileencodes — I’m hoping you are feeling the awe that your story is generating! 🤞🤞🤞

💯 3
❤️ 4
🌈 1
Denee Ferguson00:10:03

Its situations like this where auditors can be your best friend....

Topo pal00:10:14

I am so immersed in this talk that I can’t even watch slack

thankyou 1
😄 2
❤️ 2
inactive00:10:52

“Upgrades are not inherently risky…. upgrades shouldn’t be any more risky than any PR. In fact, it’s DRASTICALLY MORE RISKY than NOT UPGRADING!”

👏 1
Jeffrey Fredrick, Author-Agile Conversations00:10:55

❤️ comparing upgrading to other changes

jeff.gallimore (CTIO - Excella, he/him)00:10:58

I love the reframing and perspective with this!

Mik Kersten (Project to Product, Tasktop)00:10:23

I love that, “when you don’t upgrade, you lose out on good talent”!

Frotz Faatuai (Cisco IT - he/him)00:10:31

We found that our legacy / technical debt slowed our skills transition. Management finally had to shoot the old platform in the head so that we could get away from that technical debt.

1
inactive00:10:41

“people are not learning Rails 2… and certainly not your weird fork.” 😂😂😂

😅 2
2
Andrew Davis - Copado - DevOps for Salesforce00:10:49

"They're not learning Rails 2.3 and they're definitely not learning your weird custom fork"

💯 1
Mik Kersten (Project to Product, Tasktop)00:10:55

The “it’s no longer googleable” has driven a bunch of stack changes we’ve made…

😂 2
🤯 4
inactive00:10:16

BTW, I think “googleable” is the most amazing word every, @eileencodes

Jeffrey Fredrick, Author-Agile Conversations00:10:43

aha moment: on a wardley map your aging fork is the only node moving left on the entire map

😂 1
😱 3
Kurt A00:10:15

Makes me think of Ticketmaster's virtual VMS implementation to keep their code running 🙀

1
Pete Nuwayser IBM he/him/his00:10:46

ITRev should make this video freely available the same way that newspapers provide Coronavirus coverage for free. Avoid this disease at all costs.

👍 2
Bryan Finster - Walmart (Speaker)00:10:51

I cannot tell you how often I've told teams I'm not using their internally developed tool that duplicates something I can Google and buy books for.

👍 5
👆 6
1
Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:10

I want to drop everything and go upgrade some of our many old repos

inactive00:10:14

(I also remember reading somewhere about when the Go language team realized that “go” is nearly ungoogleable. 🙂

2
Bryan Finster - Walmart (Speaker)00:10:46

Exactly like Google +. GAH!!

Bryan Finster - Walmart (Speaker)00:10:13

I swear that's why it died.

👍 1
James Simon, FCA, Solution Architect00:10:42

Go sounds great whenever someone tells me about it. But in reality, I don't like it, not at all.

jeff.gallimore (CTIO - Excella, he/him)00:10:34

This is my new favorite talk about technical debt.

❤️ 1
💯 4
🔥 6
inactive00:10:35

“And worst of all, if you don’t upgrade, someone will propose rewriting the entire application.” 😂😂😂. So good.

💯 6
😭 2
Tim Haagenson, Software Engineer, American Airlines00:10:02

That's the secret, upgrading early and often is actually the lazy approach. I like being lazy and preventing work later!

3
💯 3
👆 1
inactive00:10:50

This part of @eileencodes story is incredible — the extent of the heroics she went through to enable upgrading safely.. I mean, holy cow…

💯 1
Mik Kersten (Project to Product, Tasktop)00:10:51

I love the way @eileencodes just framed tech debt. I’ve noticed that our devs have increasingly started using amount of code deleted as part of tech debt work.

❤️ 1
👏 3
Bryan Finster - Walmart (Speaker)00:10:04

When I started here, I used to challenge myself to see how many LOC I could remove while adding a feature. My record was ~5000. It was a small change.

inactive00:10:18

“don’t just reward feature development”

4
🙌 1
Stephen Magill [MuseDev]00:10:35

“you don’t get to develop features if your foundation is crumbling” so true!

👍 2
James Simon, FCA, Solution Architect00:10:36

Randomly assigning maintenance isn't a good plan?

jeff.gallimore (CTIO - Excella, he/him)00:10:39

“You don’t get to develop features if your foundation is crumbling.”

❤️ 1
👍 2
Istvan Bathazi00:10:45

so many extremely valuable message and lessons

👍 2
Mik Kersten (Project to Product, Tasktop)00:10:56

YES, celebrate this work! I recently sent an email to are whole company on how many lines of code we deleted as part of a bigger tech debt initiative. As important to the whole company winning a big new customer or shipping some big new feature!

Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:57

the duel booting CI is brilliant to ensure new code works

👍 1
Jeffrey Fredrick, Author-Agile Conversations00:10:09

“but it is just a warning” 🔫

👍 1
😁 3
inactive00:10:18

PS: another amazing thing about @eileencodes — if I remember correctly, her first contribution was Ruby, so that deprecation warnings could be parsed in an automated manner. (Which one needs to do when you have thousands of deprecation warnings that need to be fixed.)

Dave Mangot - Mangoteque00:10:29

So much pain, truth, and hope in a single talk

inactive00:10:45

PPS: Congrats on your recent promotion to Principal Engineer, @eileencodes!!!

🙌 8
thankyou 1
👏 3
❤️ 2
Mik Kersten (Project to Product, Tasktop)00:10:56

Oh wow, interestingly the engineer who lead our latest tech debt take down and replatforming got was promoted to Principal last week!

Jeffrey Fredrick, Author-Agile Conversations00:10:51

❤️ the phrase upgrade debt

👍 2
inactive00:10:08

“forking was the SINGLE MOST EXPENSIVE CHOICE WE EVER MADE.”

James Simon, FCA, Solution Architect00:10:09

Forking is a terrible idea, don't do it 😄

👆 1
Topo pal00:10:13

Or “Upgrade Feature”

Jeffrey Fredrick, Author-Agile Conversations00:10:21

if we call it branching instead of forking does that make it ok? :trollface:

😂 3
💡 2
3
🔫 3
inactive00:10:11

“This is for you, you technology leaders…“.

🤙 2
👏 1
Andrew Davis - Copado - DevOps for Salesforce00:10:32

Great call out @eileencodes thanks so much!

Frotz Faatuai (Cisco IT - he/him)00:10:49

Such a great callout to leaders and Product Owners…

inactive00:10:42

“Staff a team; don’t rely on volunteers.”

💯 4
Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:21

do you staff a separate team @eileencodes or is this kind of a swarming thing that happens when upgrades are required

Eileen Uchitelle - eileencodes - GitHub - Principal Software Engineer00:10:00

Depends on the app and company. We have a team, but for Ruby 2.7 we did a swarm and updated 10 apps at once.

Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:41

Interesting, in my previous employer we had a separate team to do "bug fixes and upgrades", it ended up being undesirable to work there

Eileen Uchitelle - eileencodes - GitHub - Principal Software Engineer00:10:16

We have a team that only does the github monolith. All other apps are upgraded by the team that owns them

Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:20

@eileencodes is a separate team needed b/c GitHub is a monolith (still?)

Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:43

asked the question same time as you already answered

Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:56

that makes sense, this team is like a platform team for the monolith itself

Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:43

very cool! So in a microservice world as you said, it'd be a team responsibility

Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:46

I very much regret deprioritizing upgrades, literally grown once a week b/c of this 😞

Dana Finster - Walmart InfoSec00:10:06

“The best time to do an upgrade is immediately “!!!!

🎉 2
Jeffrey Fredrick, Author-Agile Conversations00:10:45

seems like planting a tree. the best time? 100 years ago. Second best time? today.

👆 2
👍 1
Andy Nelson, Product Mgr - CH Robinson00:10:27

theres that gardener metaphor coming back

1
Daniel Cahill - Engineer - Ontario Systems00:10:36

@UP03KUG7L I think I've heard you say that on a podcast before. A couple weeks ago, I was arguing with an architect about if I should be allowed to close a year long project branch we kept taking individual features from. He wanted to push it out another 2 quarters and said "tomorrow isn't always the best day to address tech debt" and I said "Yesterday was!"

💥 2
Andrew Davis - Copado - DevOps for Salesforce00:10:20

@eileencodes what about the "let's wait a bit and see if other people have problems with this upgrade" mindset?

1
1
Frotz Faatuai (Cisco IT - he/him)00:10:06

Almost as bad. It is a conservative approach to moving forward. Kind of like standing on the breaks while going full throttle.

Istvan Bathazi00:10:10

couple year should be safe enough... and mean time fork it

😂 2
Eileen Uchitelle - eileencodes - GitHub - Principal Software Engineer00:10:22

You have more say in how that version functions if you upgrade before everyone else.

💯 1
Marc Boudreau (Enterprise Architect)00:10:59

Better yet - how about using only the oldest supported/trailing edge and upgrading then ... just as painful ;)

Eileen Uchitelle - eileencodes - GitHub - Principal Software Engineer00:10:59

If you wait and it works for everyone but you, now you have 2 problems. An upgrade and a bug that maybe is not fixable with a backport because too much time has passed

💯 2
🙌 1
Daniel Lemire00:10:39

I love the back in time assessment!

Dominic Laycock00:10:31

Upgrading while the whole community is going through the same process is a form of fast feedback, going through it while it is fresh in everyones mind is only going to help if you run into issues

inactive00:10:40

@eileencodes: @stephen and I started generating these graphs of version migration patterns, with support from a team at Sonatype — it’s amazing to see the differences. This is Java Hibernate. Might as well be two islands, where you can’t get from here to there:

🤯 2
inactive00:10:18

cc @UDL8V8FFS ^^

Stephen Magill [MuseDev]00:10:50

New APIs often improve correctness too. “oh this API is confusing and everyone misuses it” <- that can get fixed in new major versions.

inactive00:10:00

vs. Spring.

👍 1
inactive05:10:54

Cc @stephen

Stephen Magill [MuseDev]03:10:49

It’s in the 2020 State of the Software Supply Chain Report (page 30) and was generated from data on upgrade patterns for projects in Maven Central.

👍 1
Stephen Magill [MuseDev]00:10:28

I love that Spring graph. A great visualization of everyone keeping current!

inactive00:10:34

vs. Joda Time, which is like a homogenous set, where it appears one can easily go from any version to another…

Bryan Finster - Walmart (Speaker)00:10:35

Angular. We still have things frozen on Angular 1. T

Frotz Faatuai (Cisco IT - he/him)00:10:38

Keeping up to date - Same benefits apply to vendor platforms and integrations into vendor platforms. Investing in staying current should never be viewed as “expensive” or “costly”. (Minimize those costs, sure, but don’t complain about effort required…)

Stephen Magill [MuseDev]00:10:36

My fervent hope is that the shift to SaaS will make this a non-issue. Every vendor product is suddenly always up to date!

Frotz Faatuai (Cisco IT - he/him)01:10:27

Legacy world of on-prem deploys. (Monitoring systems)

inactive00:10:02

“Getting current seemed like an unachievable fairy tale…”

Bryan Finster - Walmart (Speaker)00:10:03

Going to current Angular is as hard as going to React

😂 3
Stephen Magill [MuseDev]00:10:24

Just re-write it in Clojurescript 😉 What do you think, @genek101?

Bryan Finster - Walmart (Speaker)00:10:14

We took a look a Clojuescript on my team, brains exploded, decided to implement Ramda and move on.

Frotz Faatuai (Cisco IT - he/him)00:10:33

Monkey patching - The joys of dynamic languages.

Topo pal00:10:56

“Continuous Upgrade” - thats the term I was looking for!!!

💯 1
👍 2
Adam Hawkins, SRE at Skillshare, smallbatches.fm Host00:10:03

This aligns with “fluid dependencies” discussed in “Evolutionary Architectures”

💯 1
inactive00:10:26

“Upgrades are easy, because we’re upgrading as Rails upgrades… instead of waiting years.”

💯 1
Topo pal00:10:37

CI/CD/CU

👍 2
😍 1
Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:43

b/c the Continuous Upgrade feeds into the CI and then gets deployed

Frotz Faatuai (Cisco IT - he/him)00:10:43

“continuous upgrades” - Going to have to start using that internally…

Adam Hawkins, SRE at Skillshare, smallbatches.fm Host00:10:48

It’s almost like doing things in small batches works 😄

💯 1
😁 2
Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:28

we do that for application features and delivery, but not for upgrades. Love how @eileencodes broke down that upgrades are not inherently more risky than app changes

Adam Hawkins, SRE at Skillshare, smallbatches.fm Host00:10:06

aye; given a sufficiently strong test suite and deployment pipeline the only risk is delaying the work which only increases batch size

Philip Day00:10:56

Deming would love this inter-org symbiosis

Adam Hawkins, SRE at Skillshare, smallbatches.fm Host00:10:57

Always look for ways to reduce your batch size

💯 2
Jeffrey Fredrick, Author-Agile Conversations00:10:05

helps us keep us focused on our product

🤯 2
Jeffrey Fredrick, Author-Agile Conversations00:10:41

Continuous upgrades < “if something is hard, do it more often” - Kent Beck explaining Continuous Integration

💯 9
👏 1
jeff.gallimore (CTIO - Excella, he/him)00:10:14

“…so it becomes easier.”

1
inactive00:10:14

One of the many things that @eileencodes told me that blows me away: “often, devs think locally. They think they’re the only people having a problem. They don’t realize that EVERY dev around the globe is having that same problem.” 🙏

💯 4
Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:19

@eileencodes do you have something to enforce the smaller teams continually upgrade their smaller services?

Eileen Uchitelle - eileencodes - GitHub - Principal Software Engineer00:10:56

Not quite but another team is working on it.

thankyou 1
👍 1
Eileen Uchitelle - eileencodes - GitHub - Principal Software Engineer00:10:27

Right now OKRs are it, but I hope that we'll have more tooling around it soon

Eileen Uchitelle - eileencodes - GitHub - Principal Software Engineer00:10:48

"Objectives and Key Results" for those who are unfamiliar with OKR

Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:29

I need to read up on orgs that are doing OKRs well, we attempted it in the Canada office and it didn't go anywhere 😞

Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:44

ultimately, I think it's b/c it wasn't actually measured and followed up on

Andrew Davis - Copado - DevOps for Salesforce00:10:26

This is like the ultimate argument for Trunk Based Development ... from the people who made forking a bit too easy

❤️ 2
Frotz Faatuai (Cisco IT - he/him)00:10:29

Continuous upgrades < Investment in your dependencies pays off…

Marc Boudreau (Enterprise Architect)00:10:39

@eileencodes - Awesome!

💯 3
❤️ 1
inactive00:10:47

“if you don’t like your language, change it.” 🎉

inactive00:10:06

STAND BY. TECH DIFFICULTIES in stream.

👍 4
Dominic Laycock00:10:38

I thought that was a bit of an abrupt end 😁

EmanuelMedina - Bancolombia00:10:08

hahaha, turn down the toggle feature

Istvan Bathazi00:10:13

👏👏👏👏👏👏👏👏

inactive00:10:15

Thank you @eileencodes!!! That was AMAZING!!!

❤️ 2
💯 3
Ron S00:10:26

It just stopped for me.

5
Istvan Bathazi00:10:34

👏👏👏👏👏👏👏👏👏👏👏👏👏👏👏👏

Ron S00:10:37

"See you in person next year"

inactive00:10:39

<!here> Stand by. film just barfed out of projector…

🎥 5
6
😋 8
🙈 1
😆 2
Topo pal00:10:46

Stopped…. must be the upgrade LOL

11
Frotz Faatuai (Cisco IT - he/him)00:10:58

Very smart positioning Gene! That was an awesome way to end!

👍 1
Dave Fugleberg00:10:08

DOES takes ending on time seriously

😆 13
🙂 1
😂 3
inactive00:10:21

<!here> We’re loading up the Closing Remarks. Stand by.

thankyou 6
👍 5
Joseph Laihee00:10:36

How bout you just do it live? 😉

Garrin Ball - DevOps Leader - DDMI00:10:21

that was one hell of a mic drop!

😂 15
👍 1
Lucas Melo00:10:44

Smart drama pause 😂

Dave Fugleberg00:10:02

but...I AM home !!

😂 1
inactive00:10:26

“if you don’t like your language, improve it.” And here is @eileencodes first contribution to Ruby. 🎉

Mark Fuller00:10:14

I keep waiting for @genek101 to hack the stream and jump in live....

👋 1
Jeffrey Fredrick, Author-Agile Conversations00:10:18

me prepares for post-conference #happy-hour

Ricardo Viana00:10:23

You guys should continue presenting lectures pre-recorded with the speakers answering Slack questions live from the stage and a possible quick Q&A at the end when we do this in person (hopefully) next year. This is way to good not to do again.

1️⃣ 1
💯 3
inactive00:10:41

<!here> ETA 5m. (There’s a YouTube stream we need to turn off…)

👌 5
5️⃣ 1
Craig Cook - IBM00:10:14

I'm impressed you have an ETA.

Pete Nuwayser IBM he/him/his00:10:14

Gene are you the LNO for this incident?

😆 1
Jeffrey Fredrick, Author-Agile Conversations00:10:15

A chance for everyone to add their #summit-stories

Daniel Cahill - Engineer - Ontario Systems00:10:18

Now might be a good time to ask, how many attended this year?

Andy Burton00:10:29

4667 members of general channel. Probably a decent estimate.

Andrew Davis - Copado - DevOps for Salesforce04:10:07

4,667 includes attendees from all previous DOES sessions. @mvk842 how many attendees were there for this one?

Margueritte Kim (CEO, IT Revolution, she/her)16:10:39

Hi @U017X86RZQV - We had just shy of 2,000 registrants for DOES US. Not all registrants sign onto or use Slack, which I know is surprising! We’ve been using Slack at our conferences for three years (six conferences). As you can imagine, Slack traffic has increased a lot this year!

👍 2
Marc Boudreau (Enterprise Architect)00:10:25

No (obvious) major technical difficulties until the very end ...

💯 1
Jeffrey Fredrick, Author-Agile Conversations00:10:44

We’re all looking forward to the published incident analysis.

😂 7
Marc Boudreau (Enterprise Architect)00:10:05

Is it fixed yet ... huh ... is it?

Brian Marshall00:10:54

blameless postmortem afterwards

😂 3
1
😀 1
Federico San Martin00:10:59

blameless postmortem!

1
Denver Martin - Sr. Mgr Cloud Ops Infrastructure00:10:14

There will be some learning from this I am sure…

Lucas Melo00:10:18

Who's the IC?

Pete Nuwayser IBM he/him/his00:10:21

Everyone please resist the urge to run top

Frotz Faatuai (Cisco IT - he/him)00:10:21

Here here for Gene NOT being the Incident Commander. Communicator, sure, but NOT Incident Commander 😉

Jeffrey Fredrick, Author-Agile Conversations00:10:29

Who’s on the bridge? What did I miss?

2
😀 3
🔫 1
Margueritte Kim (CEO, IT Revolution, she/her)00:10:32

of course…after a great program. :woman-facepalming:

😬 2
Philip Day00:10:35

Amazing performance art

🙂 1
Frotz Faatuai (Cisco IT - he/him)00:10:35

Leave the IC to work the issue!

Eduardo Rodrigues Semensati (Procter and Gamble)00:10:41

Opening talk from the next event should cover this, please (specially if next event is still virtual)

Lucas Melo00:10:53

Can I get an update?!

😶 1
😂 4
Pete Nuwayser IBM he/him/his00:10:19

HI WHO JUST JOINED?

😆 6
😂 3
Misty (American Airlines)00:10:34

Now that's just funny!

Daniel Cahill - Engineer - Ontario Systems00:10:24

I like to think Patrick is too humble to be recognized and stopped the stream himself

😆 1
Julien Godin-Viau00:10:34

I'm looking forward to see the incident review 😄

👍 1
Denver Martin - Sr. Mgr Cloud Ops Infrastructure00:10:36

we need everyone to take there role, let’s include everyone please…

Frotz Faatuai (Cisco IT - he/him)00:10:38

Sounds like a need for an AMA session to be called for all of the calls for an update!

Denee Ferguson00:10:39

I was paged....

Topo pal00:10:50

Ok, so who did this?

Istvan Bathazi00:10:54

perhaps closing remarks in the happy hour zoom meeting?

inactive00:10:55

<!here> …we are attempting to load up the video on Track 1.. If you’re on another track, switch to Track 1. Give us a couple of minutes to find the right files. 🙂

Marc Boudreau (Enterprise Architect)00:10:57

Someone's head's going to roll for this!!!

😅 1
Margueritte Kim (CEO, IT Revolution, she/her)00:10:04

Maybe if he had turned in those TPS reports…

6
🔥 1
😂 1
😆 1
👏 1
Brad Nelson00:10:36

He had a meeting with the Bobs.

😂 1
Garrin Ball - DevOps Leader - DDMI00:10:10

Somebody is going to be working the weekend

😂 1
Denver Martin - Sr. Mgr Cloud Ops Infrastructure00:10:12

anyone bringing doughnuts fired… bring croissants.

1
Misty (American Airlines)00:10:12

Where's @erica.morrison?!

Eduardo Rodrigues Semensati (Procter and Gamble)00:10:13

I hope @genek101 is not in the bridge. Remember the talk from @allspaw that leaders do not help as much as they think in those situations 😄

2
Andy Nelson, Product Mgr - CH Robinson00:10:18

Well they have their intro for 2021 figured out now

Jon Smart [Better Value Sooner Safer Happier]00:10:26

While we're waiting a huge thankyou to @genek101 @mvk842 @jessicam @alex @jeff.gallimore @annp @patrick.debois256 and the whole IT Rev crew for an amazing three days of learning 🙏🙏🙏

2
👏 24
🛤️ 2
upvotepartyparrot 3
🙏 5
💯 3
👍 2
❤️ 6
thankyou 26
Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:29

best run virtual conference I've been to so far

thankyou 2
👍 2
Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:44

very impressive and lots to take back to our internally run conference

Margueritte Kim (CEO, IT Revolution, she/her)00:10:16

Truly hope I get to see you in person next year, @UB5S3V9F0! Congrats on smashing it with your new book!

John Cutler00:10:32

JUST getting it running on the CEO's PHONE

📲 1
4
John Cutler00:10:40

we need a blameless retro

Mik Kersten (Project to Product, Tasktop)00:10:40

Yes huge TY!!! Amazing event!!!

💯 6
Craig Cook - IBM00:10:40

Time to share incident horror stories while we wait.

Misty (American Airlines)00:10:17

Or our infamous 'dates'

Misty (American Airlines)00:10:48

6/9/2019 and for my team 10/9/2020

inactive16:10:43

🙏🙏 TFW outages and resulting fallout and trauma cause dates fo be memorialized.

Frotz Faatuai (Cisco IT - he/him)00:10:01

I can see the start of the next session be the concluding moments of a Problem Incident Review. These are the things we learned last year…

inactive00:10:12

(…and we’re investigating a potential live option… 🙂 This is exciting. 🙂

👍 11
😃 1
😱 3
📣 1
Margueritte Kim (CEO, IT Revolution, she/her)00:10:26

Pants, Gene. Pants. That’s all I can say.

1
😂 1
Denver Martin - Sr. Mgr Cloud Ops Infrastructure00:10:15

any good campfire stories? @cncook001 looking your way….

Jeffrey Fredrick, Author-Agile Conversations00:10:57

Did I tell you about the haunted rack at our old DC?

😂 1
Craig Cook - IBM00:10:50

The one where I am a scout leader teaching a programming merit badge?

Frotz Faatuai (Cisco IT - he/him)00:10:47

Once, there was this time, at band camp…

😂 1
🎺 1
Ganga Narayanan00:10:52

Maybe this glitch was an opportunity for us to continue our fireside Slack chats!

Federico San Martin00:10:55

vote for Gene to give closing remark live on zoom

👍 5
🙂 1
Bryan Finster - Walmart (Speaker)00:10:56

Great job @annp @annan @leahb

thankyou 4
🙌 3
❤️ 4
👍 7
David Robertson00:10:57

Everybody is a comedian when it's not their neck on the chopping block.

5
🎷 1
Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:37

it'd be strange if there wasn't a blameless postmortem lol, I certainly hope so 🙂

Ricardo Viana00:10:36

Live call on Slack.....

Brian Franklin00:10:37

Normally it’s all stream, no paddle. This time, no stream, and a whole gauntlet of paddles.

😂 1
Dave Fugleberg00:10:38

It's a lot more entertaining from this side of the stream...

1
inactive00:10:06

For your amusement: here’s what’s happening… • investigating changing HTML player • live option: Streamyard to YouTube to player • maybe even just firing up a Zoom

🍿 7
3
Denver Martin - Sr. Mgr Cloud Ops Infrastructure00:10:52

if you zoom make sure to mute everyone…

😂 3
Jeffrey Fredrick, Author-Agile Conversations00:10:31

I vote just the opposite, let everyone cheer like a live audience!

Jeffrey Fredrick, Author-Agile Conversations00:10:54

I’m assuming you’ve been running this all off of someone’s tethered phone and just hit your monthly limit

4
inactive00:10:57

Zoom link coming. ETA a couple of minutes…

upvotepartyparrot 10
👍 2
🙀 1
😱 1
Jeff Giesen00:10:12

Zoom may just 2020 itself....

inactive00:10:13

The secret: positive thinking. 🙂

❤️ 2
😊 1
3
Margueritte Kim (CEO, IT Revolution, she/her)00:10:31

This is what he says about weight loss. It’s so annoying, he doesn’t eat carbs for two days and loses 10lbs. Then he exclaims “the power of positive thinking is working!” 😒

2
Mik Kersten (Project to Product, Tasktop)00:10:30

Zoom will be a great way to finish!!

inactive00:10:31

Looking for script.

😂 3
Jesse Getzie00:10:03

@UB3HU8JV6 "bag of scripts"

1
Jon Smart [Better Value Sooner Safer Happier]00:10:23

@jeff.gallimore will write it one word ahead of you speaking it 🙂

😂 3
Dana Finster - Walmart InfoSec00:10:34

paging @jeff.gallimore...

😆 2
Steve Gertz00:10:38

(and the authority to do the right thing right now)

Topo pal00:10:49

Zoom Meeting = Break Glass Approach

👍 3
Jeffrey Fredrick, Author-Agile Conversations00:10:52

The good news is you know the audience is on your side

👍 1
❤️ 2
David Roth00:10:03

if it makes you feel any better, most of the stream made it to my youtube player. Right up until Gene made his ask for help

inactive00:10:19

@alex is firing up Zoom meeting. 🙂

4
🙌 5
👍 1
👖 1
Dave Fugleberg00:10:21

learn...adapt...overcome

Garrin Ball - DevOps Leader - DDMI00:10:32

So we’re going to do some live chaos testing of zoom? nice

1
Duena Blomstrom, Psychological Safety Dashboard CEO, Author PeopleBeforeTech00:10:51

Best. DOES. Story. SO glad I didn't go to bed

😂 2
2
Arthur Maltson - Speaker, Distinguished Engineer at Capital One (he/him)00:10:44

great way to close off the conference haha, massive Zoom call 😄

1
Brian Marshall00:10:47

I remember a few chats last year about a well documented DR plan 😉

Margueritte Kim (CEO, IT Revolution, she/her)00:10:33

You’re in good company. Even I can’t get in! LOL

😅 1
Dwayne Holmes00:10:05

well done @genek101

Brian Marshall00:10:06

100 person max. bummer!

Istvan Bathazi00:10:08

lets zoom it :)

Matt Cobby (NAB)00:10:32

Devops Avengers Assemble!

👍 1
Mark Fuller00:10:14

Meeting has hit the max number of participants - please up the number!

Brian Marshall00:10:31

Lets take this to TikTok!

😆 1
Martin (TeamForm)00:10:57

that's funny for so many reasons. #geopoliticalFun

😂 1
Daniel Cahill - Engineer - Ontario Systems00:10:05

Oracle here to save the day.

😂 2
🇨🇳 1
James (TeamForm) - helping teams at scale00:10:17

Darn that Capacity Management Plan This meeting has reached a maximum of 100 participants. Please try again later. :rolling_on_the_floor_laughing:

inactive00:10:37

<!here> Stand by — finding a way to create webinar.

👍 1
Scott Prugh - Chief Technology Officer - CSG00:10:11

This is what Complex System Failure looks like...

5
Margueritte Kim (CEO, IT Revolution, she/her)00:10:28

We have the best conference attendees and speakers!!!

👍 1
James (TeamForm) - helping teams at scale00:10:48

Beer fridge still working, I can multi task

🍻 3
Scott Prugh - Chief Technology Officer - CSG00:10:51

At least you tolerate our jokes... 🙂

😆 1
Dan Sloan, Cox Automotive00:10:02

What a great 3 days! Thank you to everyone for such an engaging virtual event. Loved it. Vegas 2021 (I hope!!)

Andy Burton00:10:21

sounds like a Columbia vs. Challenger comparison -- one a failure at takeoff, one a failure at landing.

😂 1
Ron S00:10:50

Just post the closing video to the library

Tish00:10:15

Yeah... that's the first thing I did, was look for it there.

Brian Marshall00:10:59

it's on like Donkey Kong!

Eduardo Rodrigues Semensati (Procter and Gamble)00:10:10

we can read the notes and see his thought process though haha

👍 1
David Roth00:10:11

prefer behind the scenes approach 😉

Frotz Faatuai (Cisco IT - he/him)00:10:30

Would love to see the post-mortem on this one!

Mark Fuller00:10:10

I hope you are recording the live version and post it too!

Scott Prugh - Chief Technology Officer - CSG00:10:16

That was one of the unknown/unknowns we were NOT hoping for... 🙂

3
👍 3
Jon Smart [Better Value Sooner Safer Happier]00:10:05

Shallow dip into chaos, agile created Zoom webinar, to become a lean new normal? 🙂

Dave Mangot - Mangoteque00:10:11

Watching how the sausage is made 🌭

1
Frotz Faatuai (Cisco IT - he/him)00:10:23

I call that 00:19:00 outage duration. Very creative solutioning to solve the problem! Well done event staff! Kudos!

👍 3
Mik Kersten (Project to Product, Tasktop)00:10:11

Huge thanks to @mvk842 and entire IT Rev team!!!!!

upvotepartyparrot 9
thankyou 5
👍 2
👏 2
Eileen Uchitelle - eileencodes - GitHub - Principal Software Engineer00:10:41

thank you @mvk842 and @genek101 👏 ❤️

thankyou 2
upvotepartyparrot 1
👏 5
inactive00:10:03

Last words when they play the cockpit tapes from the black box: “Gene: That’s nothing. Watch this…“. [END AUDIO] h/t @jonathan_moore

🔥 3
😆 1
jon_moore17:10:20

Well, you might end up with a surgically reconstructed Achilles tendon that is better than the one you had before...so it's not all bad. 😉

Steve Gertz00:10:15

Where's that info at again? How do we share?

inactive00:10:36

we’ll post them shortly. 🙂

Denver Martin - Sr. Mgr Cloud Ops Infrastructure00:10:56

hmm, have to update the closing remarks feedback…

inactive00:10:23

“Closing speakers did not seem organized and prepared.”

😂 12
😆 5
😭 1
Garrin Ball - DevOps Leader - DDMI01:10:17

I swear that @jeff.gallimore has a tie fighter in the background?

Dave Mangot - Mangoteque01:10:21

forgot to put in the :cry-blood: emoji

Michael Winslow01:10:52

THANK YOU FOR ANOTHER GREAT CONFERENCE!!!!

Eileen Uchitelle - eileencodes - GitHub - Principal Software Engineer01:10:05

thanks for watching and the great feedback everyone!

👍 3
👏 3
Christopher S Donahue01:10:11

Thanks everyone for another Awesome Conference!

Steve Gertz01:10:15

Thanks again for a lot of love for this conference

Istvan Bathazi01:10:19

Thank you for everyone it was great!!!👏

Michael Knox (VP Ops)01:10:32

Thank you! great 3 days

Mik Kersten (Project to Product, Tasktop)01:10:41

That was great!! I think you have to do the Zoom ending every virtual event from now on 🙂

thankyou 1
1
💯 2
Federico San Martin01:10:48

thank you so much!!! this has been absolutely amazing

inactive01:10:14

Thank you, all! That was AMAZING!!! (PS: I actually like the live ending!)

👏 1
🙌 1
Pete Nuwayser IBM he/him/his01:10:24

Thank you @genek101 - I thought you and your great team recovered very nicely. This was my fourth DOES and I will always remember this ending!

Nadjib01:10:28

Well done for all and thank you!:thumbsup:

inactive01:10:30

(Although, next time, let’s do it in an planned way, not an unplanned way.)

😂 3
👍 3
Pete Nuwayser IBM he/him/his01:10:47

Now please go buy @patrick.debois256 a nice cold one from all of us

👍 1
🍻 1
😂 1
Philip Day01:10:31

How many attendees were there and how did it compare to London 2020 and to 2019 events?

nicolefv01:10:10

ahhhhhh watching this now (I had to a big TO DO today) and I might just force everyone to watch @eileencodes’s talk 💪

nicolefv01:10:30

don't mind me, i'll just sit here in channel and "live tweet" all the talks as I go thru them 😂

upvotepartyparrot 3
👍 1
Ganga Narayanan04:10:41

Please do! I plan to watch/re-watch a few over the weekend as well, and I may be checking in on the empty halls of Slack for a while as well 🙂

Margueritte Kim (CEO, IT Revolution, she/her)01:10:51

And then this happened when @genek101 tried to open our celebratory wine. 😩🤪😂:woman-shrugging::skin-tone-2:

😱 2
😿 3
😂 2
Frotz Faatuai (Cisco IT - he/him)01:10:47

It does get better! Eventually…

Jeffrey Fredrick, Author-Agile Conversations01:10:14

@mvk842 I’m going to share that in the current #happy-hour zoom!

Dave Mangot - Mangoteque01:10:15

I gotta say, I've opened a lot of busted corks with a screw and a pair of pliers @genek101. You're in good company. I feel @nicolefv judging me now. We are toasting you on the #happy-hour .

🍷 1
nicolefv01:10:45

lol I usually stick with diet coke. i'm useless when I try to open wine bottles... maybe 50/50

🎲 1
Dave Mangot - Mangoteque01:10:54

Usually don't believe it when people give me odds, but when they come from @nicolefv... 😆

😂 2
pcn01:10:19

I've never had to, but always wanted to try the shoe method

Ferrix Hovi - Head of DevOps - Siili03:10:08

@genek101 @mvk842: Where is your redundant array of bottle openers?

Margueritte Kim (CEO, IT Revolution, she/her)05:10:50

Useless until we were able to get the broken corkscrew out of the cork! A fitting end to the craziness of the closing remarks. Hope you had a great experience. TchÜss!

Ferrix Hovi - Head of DevOps - Siili06:10:55

Still having it. The redshirts are still convening.