This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
I love the term "DevEx Lens" as a way to make sure we're doing the right thing by dev teams.
Metrics should be comprehensive - qualitative and quantitive. Gathered from observability & surveys. ๐
Help me figure out how to reduce my build times. Help me understand this stack trace! ๐
๐ And now, it's time for the Godfather of DevOps, Patrick Debois, Dev(Sec)Ops Advisor & Author
The most amazing talk I've seen lately on LLMs: Jeremy Howard, one of the co-founders of Kaggle, and author of the seminal papers that set the stage for GPTs. Seeing how he write his prompts is incredible. https://youtu.be/jkrNMKz9pWU?si=U5adixKJpscwEiYQ
Strange coincidence? LLMs lose track of what's in the middle... like human brain: the primacy and recency bias focuses us on what we are exposed to first and last.
Prompt Engineering reminds me of https://en.m.wikipedia.org/wiki/Socratic_method. What insights can we glean from that, or other critical thinking disciplines?
This is a fantastic, succinct overview of the LLM landscape ๐
In search: it's difficult to convince users to ask questions, instead of typing in keywords to search for!
LLMs seem like the realization of what was to be known as https://en.m.wikipedia.org/wiki/Semantic_Web.
Is there tooling for LLMs possessing attribution to reduce hallucination and increase trustworthiness of answers provided?
AI could test another AI, such an interesting solution to a hard problem to use the probability of success to deal with non-deterministic systems.
Anyone else getting imposter syndrome after hearing this talk?
Anyone else getting imposter syndrome after hearing this talk?
Lots to learn, but LLMs feel like the imposter here. It is useful assistive technology but not fully trustworthy, another iteration of GIGO.
It will get better even as our understanding of the brainโs capabilities improve and we make better models of intelligence than iterative deep learning.
If no-one comes from the future to stop you, are you even doing AI properly?
๐ And now, our very own Gene Kim with Dr. Steven J. Spear!
The musical director deserves the MVP award for the conference.
Have time for planning and practice, so youโre not doing the most dangerous work in production ๐
Leaders need to generate (enable) the time for slow thinking to allow for deep insights and innovation
Engineers are so accustomed to not slowing down that theyโve quit asking for it. And when given time, they donโt know what to do with it anymore. Itโs like a form of PTSD.
How about โcontemplation?โ From contemplative meditative practices. Slow down to sharpen, to focus, to increase perception.
Agreed! Leaders need to also provide clarity on key targets so itโs easy to understand what might lead to valuable outcomes
The actual German word for slowification is Verlangsamung.
1
3Can we double the timeslot for @genek and @steve773? So much to try and convey in such limited time! ๐คฏ
There was a chaos monkey in those skipped slides. I vote to stay longer to hear the rest of this talk. To hell with the scheduled trains, @jeff.gallimore! ๐
That picture of the server racks not being visible through the patch cables was quote "Not so good" ๐
Great sound bite I once heard on the expressing the value of โslow is smooth and smooth is fastโ/slowification: โThereโs never enough time and money to do it right, but thereโs always enough to do it twiceโ
Slow is smooth and smooth is fast :man-rowing-boat:
Being part of a great scenius seems to be incredibly personally rewarding
Can @steve773 do the reading for the audio version of the book? This passion can't be replicated.
Gene and Steve should trade off reading different sections... or co-reading and discussion ๐
Can we please have a Dr. @steve773 narrated audio version the book?
๐ Closing the day is Adam Traina, Founder, TrainaThought LLC
Did anyone else notice that all that goodness that @steve773 read was in the first 4 pages!!! ๐ฅ
Reminder: Please submit your feedback for the talks you attended. Itโs so valuable for us and the speakers. And after all, feedback is a gift and sharing is caring! Enter your feedback for those talks here: https://doeslasvegas2023.sched.com/ https://devopsenterprise.slack.com/files/UATE4LJ94/F05UG4P024W/feedback.png
Thanks for taking the necessary time to go over your key learnings, even at risk of running over time, @genek and @steve773 ๐
โItโs a real no-code environmentโ :rolling_on_the_floor_laughing:
They changed the language ... well holy smokes.
You can preorder the book here! https://800ceoread.com/coupons/redeem/wiringthewinningorganization
1Recommended session. โHow I Wired The Winning Organizationโ @maria. Nikita 1 at 1:50. Theme is: Accelerating high tech NPD using simplification and amplification.
I couldn't find a general chat but since this is the largest forum, I want to share my summary of common themes from the first day. Summary: Developer experience, a common language, and quantifying how your team creates business value are all keys to overwhelming DevOps success. As always, feedback is not just welcome to stupid things I may say but encouraged ๐. Please share with me any key takeaways you had if you see me or DM me here on slack.
Reminder: Get yourself to your seat in Chelsea for the opening remarks. Weโre kicking off Day 2 in 15 minutes at 8:45am PDT! https://devopsenterprise.slack.com/files/UATE4LJ94/F05UG4ZGTLN/timer.png
Recommended session. โHow I Wired The Winning Organizationโ @maria. Nikita 1 at 1:50. Theme is: Accelerating high tech NPD using simplification and amplification.
4Preorder Wiring the Winning Organization here: https://800ceoread.com/coupons/redeem/wiringthewinningorganization
๐ First up this morning from U.S. Bank: Ian Eslick, Chief Technology Officer, Enterprise Architecture and Engineering; Levi Geinert, SVP, and Head of Engineering Advocacy and Enablement and Antonio Beyah, Senior Principal Engineer.
Day 2 - Excited for another engaging day or learning and sharing with my people!
Grab those papers here: https://itrevolution.com/product/the-role-of-a-platform-enabling-full-stack-software-engineers-to-their-fullest-potential/ and here https://itrevolution.com/product/the-developer-platform-run-your-platform-like-a-business-within-a-business/
4How do you ensure engineers have time to work on innersource when it may not be their primary job responsibility?
You have to build in margin into their day from the start. Set the expectation and management must protect their margin time.
set aside capacity in planning. for inner source, trainingg, tech debt. if you don't/won't , your lying to your teams and your business about TCO and caring about employees, retention, culture and big picture.
(FYI - If someone marks a post with ๐ , itโll automatically send that post to #C04ED43AQAC. Itโs a handy way to aggregate all the helpful resources from this event.)
Keep your path to prod as frictionless as possible
Continuously updated documentationโฆnow thatโs something I havenโt seen in a along time ~ obi one kenobi
1Down 3 cups of coffee already, more engineering talk please! ๐
โDonโt conflate a tool with a strategy.โ ๐ฅ ๐ฅ
Love the technical deep dive, Antonio! ๐:skin-tone-3:
๐ And now, please welcome Jacob DePriest, GitHub VP, Deputy CSO, GitHub!
"declarative" capabilities will expose the opportunities and gaps in your platform / vision rapidly enable transparency and agility.
The journey to here provides the context for now. Important to remember when we talk about modernization efforts; we each bring assumptions based on experience to the table.
To be super clear: I've been blown away by the huge investment that government and military makes in their leaders. Jacob's story is just one more example of that.
This is certainly the year of Platform Engineering and DevEx! Very exciting and relevant. This is what engineers need to bring joy to our work! Happy Engineers create better Products for our customers!
โBring feedback loop context directly into tour developers flowโ #DevEx
Bots improving security before the developer even writes code? Now THATโS shifting left on security :rolling_on_the_floor_laughing:
except that the security errors are many times BECAUSE of the limitations of the dev. Dev for creativity. AI for humanity.
Less dependency upon shared service capacity (like sec/perf/etc specialists) = โMore fulfilled devsโ AND greater predictability of delivery
There was a paper published recently on an LLM trained on dark web. It was... wild...
If developers look more like architects, how does AI empower the evolution of software architect? Does that sector go away, or does it become something different?
โDevelopers will begin to look more like architects [with AI assistance]โ - Jacob DePriest
Organizations need to learn to be successful because of technology instead of despite it by embracing and supporting all of these great tools.
Jacob will be hosting that Q&A Session later today at 3:00p in Nolita 1!
๐ Next up is Max Reele, Air Force Lead, Defense Innovation Unit (DIU)!
We need a DevOps Enterprise Summit Spotify playlist.
โWe havenโt properly lamented the death of PCFโ - Paul Gaffney ๐
I feel like Anthos will be the first to bring that experience back ๐
I LOVE โค๏ธ the pickup of tech and Devops in the gov/mil sector in the last decade. DOES has definitely been an impactful force on that!
DOES gave me the language to describe and improve many things
Talk about critical systems... outcome within 24 hours in operations zone.. epic.
Exactly.. and we cry for compliance in normal world.. if this is doable, we should rethink our privileged contexts
โBecause we had trust with this group, they trusted that we would attack this problem WITH THEM.โ
They built the trust over time so they had it when they needed it. And everybody benefited.
Private sector aside....Think about what SRE resiliency and stability and Devops scaling and repeatability principles do for actual military security and the potential of saving lives.
Itโs been said that the US military is โthe sharp instrument of a blunt policy.โ Whatever the policy, the levels of leadership, commitment, and execution on display here are amazing.
The quote is from TIMEโs choice for โPerson of the Yearโ in 2003 (twenty years ago!) - The American Soldier https://www.defense.gov/Multimedia/Photos/igphoto/2001084911/
The accompanying article: https://content.time.com/time/magazine/article/0,9171,1006533,00.html
The actual quote: โThey are the bright, sharp instrument of a blunt policyโฆโ with respect to the Iraqi war.
"The privilege of accountability" - I love this
Love mission obsessed work environments! Whatโs your one mission metric that matters? Are we all rallying behind it!?
I observe that changes to these applications didnโt have to wait for a new PI. Letโs move fast!
"DevOps breeds organizational optimism!" @mreele
If you love this story, highly recommend reading (Re)coding America by Jen Pahlka. It will completely change your perspective on government in a digital age. Top 5 book Iโve read in the last few years.
What an amazing presentation @mreele !! โฆ way to have โslowifiedโ to make that all happen!
The "Liaison model" continues to be hugely powerful in building feedback and a user trust model.. Team of Teams highlights this at scale
@mreele stellar job! Fabulous example of gracious perseverance.
User Trust Model: Consistency, Transparency, Frequency
๐ And now: Courtney Kissler, SVP, Customer and Retail Technology, Starbucks and Paul Gaffney, Chief Digital Officer, Omni Logistics
Super glad to see @ckissler and @paul.gaffney on stage presenting together
Effectiveness over efficiency. Performance over productivity.
That resonates, given all of the recent handwringing over โproductivityโ in the last year in light of discussions about return to office and corporate profits.
Yup! Check out this article by some DORA community members (including Denali Lumma, who is here at DOES) for more on that topic: https://dora.dev/devops-capabilities/cultural/how-to-empower-software-delivery-teams/
Make sure you build the right thing, not just build the thing right.
Power driven and task oriented vs. Values driven and outcome oriented Easy choice. I know which one I want. ๐
Not a little happiness in the moment, but perhaps a little less pain for the moment.
It is paramount for developer motivation that they know and see they are providing real value
Love the connection between effectiveness and happinessโฆ people donโt mind hard work, people donโt even mind suffering โฆ. People get unhappy when theyโre working-hard/suffering without reason and without end. Effectiveness is a proxy for a grander purpose
Just imagine if this was your CTO talking. ๐
Don't capitulate, persevere and keep talking about things that matter
I feel this call to gracious perseverance in my soul
A caution to this community from @paul.gaffney : "Don't focus overly on efficiency. That's too easy to get delegated away. You don't want to have a job that is just delegated away. You want to be the person doing the delegating."
Really enjoying the focus on building happier leaders in so many of the plenary sessions, and tying that emotional satisfaction back to corporate success is awesome.
I sense some of the capitulation is rooted in the desire for conflict avoidance. Conflict arises naturally from differences in ideas, expectations, and opinions. Learning to honor those differences is a great skill in leadership, and in personal relationships.
Hard to be gracious when youโre trying to persevere for betterment when you continually hit roadblocks. Teach me the way to to be consistently gracious!!
OMG. Excel is more destructive than PowerPoint?! Hahaha.
"Powerpoint: the most effective tool for delivering someone's opinion!" @paul.gaffney
Don't capitulate... โThe only phrase I've ever disliked is, 'Why, we've always done it that way.'" -- ADM Grace Hopper
Paul woke up and chose violence today with that excel comment ๐
Conference only half way through, and Iโm already declaring my favorite talk. AWESOME @paul.gaffney @ckissler
1If we're going with opinions, let's use mine. Everyone else bring facts.
Capitulation pressure is very real and exponential in regulated environments. Fear of passing audits can become more valued than innovation and delivery to eliminate fear of audits.
How many orgs today have a 1:1 ratio of individuals to realities? :thinking_face:
Capitulation seemes related to the disfunctional cockpit command system discussed before at DOES
Reality is often inconvenient... to quote myth busters "I reject your reality and substitute my own"
Leadership courage vs team members psychological safety!!
When will moments to display courage present themselves and how will you be able to take advantage of it?
So many stories of mindless standardisation past, present and incoming at this conference!
When the solution becomes more important than solving the original problem...
What is the subtle art of speaking up while not pissing people off? @paul.gaffney
I need to learn this magical skill that provide me agents to piss people off! This sounds brilliant
"Most will capitulate. Your job is to lead." @paul.gaffney
If it doesn't make sense to you, it probably doesn't make sense to others. Ask the question. You're asking for more people than just you.
When I encounter those situations, I always ask myself if this is the โhill I am going to die onโ. Doing whatโs right is never easy.
"Courage, Justice, Temperance and Wisdom" Stoic principles are a great fit to true and happy leadership!
Agree!! I also like โcalm is contagiousโ. Daily Stoic is one of my favorite books.
If no one speaks up, we all may suffer. Graciously preserver in your leadership journey :saluting_face:
"Leaders delegate efficiency. Leaders focus on effectiveness." @paul.gaffney
I wonder if I was ever someone else's agent without me knowing :thinking_face:
Whatโs your favourite guidance on โfocus on effectivenessโ?
Iโm predicting that Engineering Effectiveness and *Engineering Enablemen*t are on the horizon for the DevOps community.
@daniel.capetta is leading an Engineering Effectiveness team in his organization.
I am having so many aha moments right now! Being a new manager for 1.5 years, I am very inspired right now! Thanks @chawklady and @paul.gaffney !!! :right-facing_fist::skin-tone-2:
Look at your calendar and change the ratio. <โ so much power in this.
https://itrevolution.com/articles/how-to-talk-business-a-short-guide-for-tech-leaders/ ๐
Gene, when will IT Rev be publishing a Paul Gaffney book? ๐
Get Clarissaโs book Beyond Agile Auditing and get it signed tonight after the Lightning Talks!!
๐ Clarissa Lucas, Thought Leader, Internal Audit Leader and author of Beyond Agile Auditing
PS: I was a card carrying member of the Institute of Internal Auditors and ISACA for 8 years.
Can confirm. And they were SUPER popular in that they had a conference every year over Valentineโs Day weekend.
"calling your auditors to spend time with you" - @lucasc5. educated me on this last year and I started. Now we're buds :)
And most of the auditors I hung out in the 2000s with feint with shock at this โย just like Ops people feinted with shock when they saw the 2009 Allspaw/Hammond presentation. ๐
Really enjoyed working with our internal auditor and creating a VSM to integrate and automate audit which was a manual and time consuming process
@lucasc5 we have written a paper that leans into Value Stream Management Implementation Roadmap, Team Topologies and some new concepts we have hypothesized. I see no reason for Audit not to be playing a part in any Value Stream Reference Architecture. We have a link to the paper in #C0475QGFL3S and we are talking about it at 1:50 today
You either die as a client or live long enough to see yourself become an auditor ~ Batman (probably)
Interested to hear whoโs working on auditing workflow and workflow-bill-of-materials :man-raising-hand:
Segregation of duties is ONLY a type of control. Not an end in itself.
Pre-planning with your auditor will help both them (transparency and learning for them) and you (audit is focused on reality).
Ask for every control, or ask for whatโs applicable (whatโs valuable to the local context)? ๐ญ :thinking_face: โค๏ธ
I love the "integrated planning" concept. My team has started spending regular routine time in all of our product planning/intention map routines with our audit partners at the table, so we proactively prevent audits, so we build best practices into our products to mitigate any audit risk and its been game changing - especially in Target's food traceability efforts
Auditing always makes me think about the step beyond โwhat we knowโ to โhow do we know?โ and โwhat we didโ to โhow did we do what we did?โ
I did not bring our internal auditor @lucasc5 but she is a big fan of your work! Thanks for all you're doing!!
I propose a New-Year countdown for todayโs emergency alert test.
Give yourself a legitimate relationship with time.
ยซย Tell me moreโฆย ยป, so true. :right-facing_fist::skin-tone-2:
Ouch, correlation is actually a pretty low bar too!
A former boss used to say that when a company created a value statement, it was usually in response to a gap in culture. โWe act with integrityโ usually meant that there was a noticeable gap there. Cynical, but thereโs some truth there (and an opportunity for improvement).
Zero correlation between words of leaders and the lived values from the employeesโ perspective ๐ญ
Sometimes corporate values are too vague and corporate BS speak and they can be hard to follow anyway
The higher you are in an organization, the less quality feedback you receive
Everyone loves a good compliment. :woman-tipping-hand:
I think this might be the MIT research? https://sloanreview.mit.edu/culture500/research
Upward positive feedback to create the leader you want to work for @drandremartin
Manager: Dare to ask "Do you have any feedback for me" @genek
Learn even more from Andre at his Learning Sprint today at 3:00. And, grab his book WrongFit, Right Fit tonight at the book signing.
What an interesting experiment in testing latency of various networks. My phone was actually several seconds behind others and I still hear it going off on others behind me.
Part of me wants to figure out how to disable the emergency broadcast notification on my phone...but is that wise? :thinking_face:
Project to Product has had a truly massive impact on how organizations are approaching their IT/digital operating model. It's everywhere, from the largest banks to mid market companies.
Kudos to Mik for just running with such a massive distraction
๐ for Mik powering through a nightmare for speakers with absolute poise ๐
Normal government reaction to tech innovation talk โฆ
Upstream and Downstream from typical DevOps scope is the biggest blind spot for technical leaders
imagine.... "Let's pivot/modernize our app from language X to language Y. " Click! Build. Test.
Wow, business leaders think that digital teams have 10x the capacity they actually do! That's not the 10x we are looking for ....
transparency of intentions and capacity come to mind. tear down those silos!
Will LLMs allow the late majority to catch up modernising and connecting their digital value streamsโฆ
โWhen presenting to executives, explain it like you would to a five-year-old child. And donโt read too much into that.โ :rolling_on_the_floor_laughing:
omg. Automated, full org automated flow metrics! Merge with DORA drill throughs. ๐ฅ ๐ฅ
We need to bring dependencies out of the dark into the light
5 year old children are way more curious (on average ๐ )
โLooking at your backlog and throughput, you have 1000 years of work outstanding. Luckily, you have a backlog prioritization meeting tomorrow.โ :robot_face:
Ask JiraGPT to prioritize itโฆ :face_with_rolling_eyes:
Amplification, simplification and slowificationโฆIโm sensing a trend
Recommended session. โHow I Wired The Winning Organizationโ @maria. Nikita 1 at 1:50. Theme is: Accelerating high tech NPD using simplification and amplification.
๐ Please welcome Stephen Magill, VP, Product Innovation at Sonatype!
Just released yesterday! https://www.sonatype.com/state-of-the-software-supply-chain/Introduction
Respect developer time and embrace innovation. Rate of new open source projects is increasing
Key to success: good olโ dependency management. How often do we look for more โadvancedโ solutions and ignore the basics? ๐คท
Thanks all! You can chat with Stephen at the Sonatype booth for any lingering questions
๐ Please welcome Joseph Enochs, Managing Director: Emerging Technologies โ Enterprise Vision Technologies and our very own Gene Kim!
How many of the Google searches for generative AI were made by AI? :thinking_face:
Belt-fed inspiration this morning! my backlog of โdeep-work sessionsโ to process all these lessons & spin off ideas is getting out of handโฆ
So many resources in this talk. So much homework to doโฆ
Any sufficiently advanced technology is indistinguishable from magic ๐ง
To reference @mik โs earlier talk, somebody needs to explain AI from the perspective of a five year old.
The more talks I listen to, the deeper I feel in tech debt. :rolling_on_the_floor_laughing: I just might have to accept/conform with the AI reality to keep up. ๐ค
Curious about where work is being done on cost of delay on AI
Check out an example of the summaries Gene just mentioned here: https://videos.itrevolution.com/watch/827527977
โTo go on interesting quests, you need to have interesting friends.โ โค๏ธ
To do interesting things, you need interesting friends < this sums up so much about this community that I love.
John Willis's book Deming's Journey to Profound Knowledge is available in ebook and audio now. You can get the paperback version at the book signing tonight! https://itrevolution.com/product/demings-journey-to-profound-knowledge/
Also, John will be hosting a second session of his popular Learning Sprint on Deming again today at 3:00! Maybe you can play your hand at the red bead game?
:man-raising-hand: would absolutely join a field trip to Japan for this learning
Theater is very cold. Can we adjust temperature's?
serยทenยทdipยทiยทty /หserษnหdipษdฤ/ noun the occurrence and development of events by chance in a happy or beneficial way. "a fortunate stroke of serendipity"
Recommended session. โHow I Wired The Winning Organizationโ @maria. Nikita 1 at 1:50. Theme is: Accelerating high tech NPD using simplification and amplification.
"One of these days will be the best day of your life. Let's have a great life together."
Definition: (I had to look it up): In Japan, onsen (ๆธฉๆณ) are hot springs and the bathing facilities and traditional inns around them.
It's so fun to learn from @botchagalupe and the journey he takes us on ๐
I witnessed the 7 minute cleaning earlier this year in Japan. It is amazing and was really clean.
@genek - was John the inspiration of the โyou need interesting friendsโ quote?
John's warm passion on stage almost makes you forget how cold it is in here ๐ฅถ๐ง
Reminder: Please submit your feedback for the talks you attended. Itโs so valuable for us and the speakers. And after all, feedback is a gift and sharing is caring! Enter your feedback for those talks here: https://doeslasvegas2023.sched.com/ https://devopsenterprise.slack.com/files/UATE4LJ94/F05UG4P024W/feedback.png
Reminder: The breakout sessions are starting in 5 minutes. Start navigating your way to whichever session youโre attending. https://devopsenterprise.slack.com/files/UATE4LJ94/F05UG4ZGTLN/timer.png
Reminder: The breakout sessions are starting again in 5 minutes. Start navigating your way to whichever session youโre attending. https://devopsenterprise.slack.com/files/UATE4LJ94/F05UG4ZGTLN/timer.png