The Art of the Wargame (Black Hat Review)Patricia Brosey
2
Without knowledge of the enemy, the General commits catastrophic errors.
All is lost.The Art of War
The Denma Translation Group (DTG)
3
Black Hat Review and the Art of Winning
• Plan and wage war in the Black Hat review • Create potential war scenarios by aligning ourselves and our
allies against a set of opponents • Assumes the competitor mindset • Collects intelligence and develops their battle plans• Use rules created to closely simulate battle conditions
(proposal instruction and evaluation)• Executes the war game in front of the evaluators • Only one team is victorious
We can learn as much about our strategy and position as we do about the competition.
4
This Black Hat Process Black Hat Kick-off
Review Preparation
Leverage Black Hat Products
Black Hat Review
Support Solution Develop-
ment
• Define the information you must learn upfront
• Develop high producing competitive teams
• Develop customer team
• Team researches and develops strategies and solutions using the competitor’s mindset
• Facilitate solution development
• Provide good data
• Teams present battle plans
• Teams answer clarification questions
• Customers score presentations according to evaluation criteria
• Teams recommend strategy changes
• Team resolves review action items
• Team updates the capture plan and strategies
• Team leverages in ‘Bid/No Bid’ gate review
• Define process and teams
• Define questions and rationale
• Define reference material
• Describe expected products
After attending this presentation, you will understand this Black Hat process and how to maximize your Black Hat ROI
3-5 days 1 day
5
"If I wish to take advantage of the enemy I must perceive not just the advantage in doing so
but must first consider the ways he can harm me if I do.“
Tu Mu, Chinese military commentator
(803-852)
Define the Information You Need Upfront• Work with the capture team to determine what essential
information we don’t know– Competitor– Customer– Procurement environment
• Consult the Draft RFP to use the evaluation criteria and required proposal data
• Define the question(s) and instructions - open ended questions are best
• Always include PTW resources in your Black Hat review – this discussion is valuable
6
Lesson Learned: Focus the Black Hat on information you need
Review Preparation
7
Knowledge of self and other is vital to the General in every endeavor. Yet it is
insufficient without knowledge of the ground, the environment within which the
battle occurs.
The Art of War (DTG)
8
Information You Should HaveCompetitive Information– Team composition– Win strategies– Baseline solution (technical,
management, pricing, transition)– Re-badging strategy– Reuse strategy– In-depth pricing data from relevant
contracts – How will they “ghost” the other
teams?– Related past performances– What “out of the box” ideas will the
competitors propose? – SWOT– Customer influence chart
“Environmental” Information– Customer buying patterns– Budget pressures– Strategic fit– Customer advocacy– Right solution– Financial objectives– Real, funded, timely opportunity
with champion– High win probability
Review Preparation
Develop High Producing Competitor Teams• Each team assumes the competitor’s mindset• Focus on active, diverse participation and having fun• Teams should include members of your capture team, teammates,
PTW, former employees, “grey beards”, consultants, ex-customers of these companies
• Cross company teams allow people to get to know each other and work together early in the capture process
• Make this review fun – Foster competition among the teams – Dress like the competitor you represent – Wear black hats – Select and reward a winning team
9
Lessons Learned: Knowledgeable teams with active, diverse participation focused on fun are high producers
Review Preparation
10
Develop Customer Team• Customer team assumes the Evaluation Panel mindset and
provides valuable customer feedback• Team should include someone who has been a customer or
supported a customer as a technical, management or pricing SME; must understand the customer mission, organization, why the procurement will occur. Must understand RFP requirements. Often include senior strategists, BD professionals, former acquisition experts, consultants
• They prepare by reading and understanding the RFP; create evaluation scorecards
• They provide customer insights – customer ‘hot buttons’, history, informal organization, how to influence the customer
Review Preparation
Kick-off Black Hat Review • Define process and competitor teams
– Prepare slides that address defined questions– Set expectations about solution presentations (1 to 1-1/2 hours)– Account for probable Section M evaluation criteria
• Define questions we need answered and why• Define available reference material• Product: Discussion of our team’s solution
– Win strategy and solution– Strategies and plans– Price-to-Win model– Proposal preparation– What should we “shape?” Evaluation criteria changes?
11
Start with the end in mind
Black Hat Kick-off
Example Instructions Given to Teams• How will your team respond to this procurement’s RFP in the
following areas?– Team composition (1 slide)– Win strategies/win themes (1-2 slides)– Baseline solution for technical, management, transition (4-6 slides)– Re-badging and/or reuse strategy (1 slide)– What pricing strategy will you use? What specific actions will you take to
lower your price? How can you interpret the pricing instructions to benefit your bid? What pricing recommendations would you recommend to the customer? (2 slides)
– What “out of the box” ideas will the competitor team propose? (2-3 slides)
– Strengths and weaknesses (1-2 slides)– Customer influence chart (1 slide)– “Ghosting” of the other teams (1-2 slides)– Related past performances (1-2 slides)
12
Black Hat Kick-off
13
Facilitate Solution Development• Have you ever supported a team who couldn’t define their
competition? Or a a team who was sure they were going to win? Were they so sure, they were arrogant? We can teach valuable lessons during a Black Hat.
• Proposal Manager is review facilitator, participates on all teams– Set expectations and schedule upfront– Assign team leads – Help teams through the ‘forming, storming, norming to performing ’ process
quickly– Focus teams to gather and organize sufficient detail– Keep all presentations at the same level of detail– Check for common understanding of and compliance with instructions– Help teams locate competitive information – Motivate the teams to create a better solution
Lesson Learned: Proposal Manager facilitation is key to success
Support SolutionDevelop-
ment
14
Optimize the Teams’ Solutions• Solution is as good as the data it’s based on
– Base on your capture plan data collection– Use your PTW resources– Use a known, proven competitive intelligence data source
• This process promotes optimization– Ask questions about the teams’ products as it’s developed – anticipate
the Customer Team’s questions– Ask the teams to “ghost” the other teams – Focus the teams on defined questions they are missing – Question your team’s false impressions – Third party scores solution and offers recommendations
Lessons Learned: Solution is as good as the data it’s based on; process is focused on questions and recommendations
Support Solution Develop-ment
15
Black Hat Review• Teams present their solutions• Members of competitor teams may ask questions to probe or
clarify materials presented• Customers score presentations according to expected
evaluation criteria• Discussion of our team’s solution
– Determine how our win strategy and solution should change– Determine guidance on Price-to-Win model– Provide guidance for preparing the proposal
• What aspects of these procurements should we "shape?” What should the evaluation criteria for this procurement be?
• Collect actions for our team
Black Hat Review
16
Leverage Review Results in Your Proposal or Support a “No Bid”
• Collect actions that affect your strategies to increase your odds of winning– Teaming actions – determine who is strong where you are weak, they
should be on your team– Finalize your win strategies – define why we should be selected and
not the competition
• Results transition to capture plan• Results may lead to “No Bid” decision
– Resources required to beat the competition may be too much– It’s better to no bid and spend your scarce B&P funds on a winning
opportunity
Lessons Learned: Results will affect your strategies to increase your odds of winning or support no bid
Leverage Black Hat Products
17
Summary• We can learn as much about our strategy and position as we
do about the competition.• Define the information you must learn upfront
– Focus the Black Hat on information you need– Black Hat reviews can initiate, supplement and validate your capture
plan
• Develop high producing teams – Knowledgeable teams with active, diverse participation focused on fun
are high producers– Proposal Manager facilitation is key to success
• Optimize the teams' solutions and use them– Solution is as good as the data it’s based on and process is focused on
questions and recommendations– Results will affect your strategies to increase your odds of winning or
support “no bid” gate review
18
True knowledge of the enemy comes from active
contact, which the General initiates and conducts. He provokes them to reveal
themselves, assessing the full extent of their reactions and resources.
The Art of War (DTG)
19
About the AuthorPat Brosey has more than 20 years experience capturing, creating solutions and managing new business efforts to US Government agencies. She led dozens of successful competitive Black Hat reviews using this process which led to numerous contract wins. Recently, she has managed numerous proposals, independently assessed capture activities, crafted cost strategies and supported process improvement efforts. She is a speaker for the APMP National Capital Area Chapter and a member of the Roundtable Planning Committee. She is PMP and AM.APMP certified.