cost assessment data enterprise...what is happening with cost performance index (cpi) across the two...

COST ASSESSMENT DATA ENTERPRISE

24 June 2020

FlexFiles Update & DAU Webcast

2

AgendaImplementation

• FlexFile and Quantity Data Report have replaced DD 1921 Series as the default required cost reporting requirement for newly approved CSDR plans as of 15 May 2019 (per DDCA memo)

• Some tailoring of the DID requirements may be proposed by the CWIPT (e.g., time-phasing for periods longer than a month)

• If there is context-specific rationale, e.g. the reporting contractor and effort being performed make it unlikely the additional insight provided will be utilized, then the CWIPT may propose to use the DD 1921 series

Jack Titus- CDSG CADE Validations [email protected]

Torri Preston - CDSGCADE Training & Engagement Lead

[email protected]

Benjamin Berkman - CDSGCADE FlexFile Support

[email protected]

Peter Braxton - CDSGCADE DAU Lead

[email protected]

Ryan Horn - CDSGCADE Training Support / LMS Lead

[email protected]

DoDI 5000.73 Update

OSD CAPE Policy Update

DAU Webcast

FlexFile Overview

FlexFile Data Groups

FlexFile Submissions

FlexFile Exports

CADE Data Access & Analytics Demo

DAU Webcast

Presenter

Presentation Notes

Poll Title: In one word, what fun activities have you been doing in your spare time while social distancing?https://www.polleverywhere.com/free_text_polls/gx1ajxxV0uImb7qYWlOC8

Presenter

Presentation Notes

Poll Title: What organization are you representing?https://www.polleverywhere.com/free_text_polls/y6HQB6zTjrUfAP90UzKB1

Presenter

Presentation Notes

Poll Title: What do you hope to gain from this training?https://www.polleverywhere.com/free_text_polls/Q5mH0M1L60IfI4OS9Vvbu

DoDI 5000.73 Update

• Approved by DCAPE, dtd 13 Mar 2020 (1st update since 2015)• Alignment with Acquisition Pathways

• Major Capability Acquisitions – traditional MDAPs• Middle Tier of Acquisition (MTA) Programs – aka Section 808• Defense Business Systems (DBS) – Artist Formerly Known As MAIS• Contracted Services• Software

• Importance of uploading documentation to CADE Library• Clear CSDR requirements by Acquisition Pathway (Table 1)

• In a nutshell, ACAT I and II level programs

• Access via https://cade.osd.mil/News/blog

DAU Webcast

6CSDR applies to more programs than ever!

Replaces DoDI 5000.02 Table 7

Presenter

Presentation Notes

O&S Visual Analysis Tools (VATs) have not been maintained. Possibility of parsing IMS files?

https://cade.osd.mil/News/blog

Presenter

Presentation Notes

Poll Title: For the programs/projects you support, how much of an impact has COVID-19 had?https://www.polleverywhere.com/multiple_choice_polls/vGYWr2XMyOPfB2WQ3XDqB

COVID-19 Background and TimelineDAU Webcast

8

Effort to effectively capture COVID-19 cost, schedule, and performance impacts has been and will remain an iterative and collaborative process between Government and Industry

March April May June+

Reviewed lessons learned from Hurricane Katrina• Determined similarities

between Hurricane Katrina and potential impacts of COVID-19

• Interviewed SMEs with experience using data from that timeframe

• Reviewed CCDRs and CPRs from contractors who were impacted by the storm

• Reviewed studies highlighting macro level impacts from that timeframe

Worked with leadership to develop memo• Goal is to account for COVID-19

impacts without being overly prescriptive or burdensome on Industry

• Ideal “win-win” solution aligns Industry data collection with Government data reporting

• Memo signed May 27th and posted on the CADE public website

Hosted Mini-Focus Group to solicit community feedback• Collected information from

Services to determine information required and suggested medium for collecting data

• Surveyed industry to understand current impacts, previous experiences, and actions that are currently being taken/will be taken during the crisis

Continue dialogue at Cost IPT and CADE Focus Group• Will continue to iterate and

collect lessons learned to provide industry clear guidance on how to report impacts

• CIPT 22 Jun – update on impacts and approaches

• Focus Group 21 Oct –continuous collaboration and feedback loop

Legend

Hurricane Katrina Cost ImpactsDAU Webcast

Like Katrina, COVID-19 impacts are expected to be wide-ranging and long-lasting9

Katrina Impacts Cost

Change in Ship EAC Damage Down Time

Direct Labor Hours DL Rate

Pre-K K Impact Pre-K K Impact

Facilities

CFE//GFE

DL OH

DL MnHr Growth

Hours, Loss in Productivity

InsurancePremiums

Depreciation

Vendor Premiums

OH Rate Material Cost

Pre-K K Impact

MedicalDL Ratesgo up

Same Labor Problems

Transportation

Outsourcing

Indirect LRgoes up

Ship Damage

SHIP Damage

SHIP Damage

GovernmentCost

InsuranceClaims

Mixture

Ad hoc data collection was the main data source to develop estimates of Katrina impacts. Recommend programs document plan to capture COVID-19 impacts and share with CAPE, the Services, and A&S

10

Hurricane Katrina vs. COVID-19 Compare and ContrastDAU Webcast

Katrina COVID-19 Consequence

Acute Prolonged Untangling Katrina effects was necessarily reactive; here we have the chance to be proactive!

Regional(Natural Disaster)

National(Global Pandemic)

Katrina primarily affected Ingalls (Pascagoula, MS) and Avondale (LA) shipyards; COVID affects entire supply chain!

Insurable Not Insurable No “physical loss or damage,” likely that Government will bear the brunt of COVID-19 impacts

Impact Model* Unknown / Unlikely Advanced Learning Model (ALM); With no model in place to quantify impacts a priori, proper tagging of impact data becomes all the more crucial

Local IT / Hard Copy, COOP Response Robust Cloud Infrastructure Firms should be much better positioned both to minimize White Collar impacts (i.e., WFH)

and to capture Blue Collar impacts (see below)

Infrastructure Damage Preventative Measures Firms already implementing health and security procedures, reconfiguring plant layouts, etc.; mixture of Direct and Indirect

Workforce Displacement

WorkforceDisruption

Green Labor effect predicted by ALM 2*; only expected insofar as employees die (!) or leave for personal reasons

Work Stoppage (extended) Work Stoppage (temporary) Loss of Learning due to Interval predicted by ALM 1*; expected where production restrictions result in significant delays

Work Disruption Work Disruption Without proper data tagging, it was practically impossible to attribute unproductive time, partially productive time, SWBS, etc.

* “An Enterprise Model of Rising Ship Costs: Loss of Learning Due to Time between Ships and Labor Force Instability,” Richard L. Coleman, et al., Department of the Navy Cost Analysis Symposium (DoNCAS), September, 2008.

Mat

eria

l Diff

eren

ces

Resu

ltant

Impa

cts

OSD CAPE Memo sets the stage for more specific guidance11

Summary of Current Guidance

• Guidance Memo Ultimate Objectiveo Government and Industry both need to be tackling the problem of tracking COVID-19 effectso Coordinated with ASD(A) and Service Acquisition Executives (SAEs)o Including Defense Pricing and Contracting (DPC) and Earned Value Management (EVM)o Links to DPC and other guidance in Back-up

• Memo Highlightso Government and Industry work together to develop approach to capturing COVID-19 effectso Effects should be discernible from non-COVID-19 factors to the maximum extent practicableo Effects should be included and documented in CSDR and IPMDAR deliverableso Neither contract changes nor allowability of costs implied

• Additional Guidance Pendingo Eschewed “Attachment A” in initial memo with more specific guidanceo This CIPT meeting is the next step toward developing that more specific guidance

DAU Webcast

Presenter

Presentation Notes

Read-ahead request: “Please submit questions regarding the memo to Mr. Bryan Coots prior to the meeting” [email protected]

Now is the time to make your voice heard!

• Looking at the problem from both sideso Industry – “forward pass” – how are impacts accounted for and reportedo Government – “backward pass” – how are historical data normalized and analyzed

• Common Goalso Industry and Government both seeking to understand the impacts of COVID-19 so that the “underlying

actuals” can be effectively used as the basis for proposals and estimateso Also informs future Risk Management (“COVID-19 was not a black swan…”)

• Future Guidanceo Seek to be comprehensive in treatment of scenarios, impacts, and reporting mechanismso Furlough, plant shutdown, additional health and security measures, production line reconfiguration, supply

chain disruption, etc.

12

Objective of Shaping Future GuidanceDAU Webcast

Presenter

Presentation Notes

Need graphical treatment of Common Goals bullet to illustrate.

Cost Data – Basis for an Analogy Estimate

Problem

• A project started in mid-2019 and concluded in mid-2021

• Total cost was $5.9M

Questions

• What was the (approximate) burn rate?

• What adjustments might you need to make to this data point if used as the basis of an estimate?

Every program is either “lucky” or “unlucky”13

Conceptual FrameworkDAU Webcast

This series of slides was presented to the Naval Postgraduate School (NPS) Masters of Cost Estimating and Analysis (MCEA) program on April 15th, 2020

Risk Data – Plans vs. Actuals

Problem

• Project start was 01 Jul 2019

• Originally planned to conclude on 31 Dec 2020 at a budget of $3.6Mo Actual finish was mid-May 2021

Questions

• What was planned burn rate?

• What is Cost Growth Factor (CGF)?

• What is Schedule Growth Factor (SGF)?

Program growth may result from endogenous and exogenous risks14


Recall that Time-Phased Actuals is one of the FlexFile “Big Three”15


CCDR Data (1921) – Limited Time-Phasing

• CCDR Annual Reports as of the end of each calendar year

• In which report did WBS 1 growth show up?

• In which report did WBS 2 growth show up?

Initial 2019 2020 2021 TotalWBS1 $0.6M $0.6M -- $1.2MWBS2 -- $2.4M -- $2.4MTotal $0.6M $3.0M -- $3.6M

Year 1 (2019) 2019 2020 2021 TotalWBS1 $0.6M -- -- $0.6MWBS2 -- -- -- --Total $0.6M -- -- $0.6M

Year 2 (2020) 2019 2020 2021 TotalWBS1 $0.6M $1.3M -- $1.9MWBS2 -- $2.8M -- $2.8MTotal $0.6M $4.1M -- $4.7M

Year 3 (2021) 2019 2020 2021 TotalWBS1 $0.6M $1.3M $0.1M $2.0MWBS2 -- $2.8M $1.1M $3.9MTotal $0.6M $4.1M $1.2M $5.9MAnnual phasing the best

you can do without EVM/FlexFiles

EVM Data – Progress Metrics

• Monthly IPMDAR data identify performance issues

• What is happening with Cost Performance Index (CPI) across the two WBS elements?

• What is happening with Schedule Performance Index (SPI)?

16


17


Unraveling the scenario…

Pre-Crisis [would have been]• Stable operating environment with CPI

and SPI near 1.0• Two WBS elements

• Control Accounts, WPs,…• Easily extensible model

Crisis• WBS elements are assumed to be wholly

unproductive during all or some of the crisis period

• May affect different elements differently

Post-Crisis• WBS elements are assumed to transition

to partially productive as some point• For sake of simplicity, no amelioration for

duration of task

Ground Truth – The Virtue of Conceptual Models

FlexFiles

• Time-phased monthly data• Burn rate increases ca. Sep 2020

• WBS1 $105K/mo $118K/mo• WBS2 $222K/mo $248K/mo

• No insight into progress (EV)

DAU Webcast

18

RECOMMENDED REMARKS / TAGS

• “WBS1 was severely impacted from Mar to Aug 2020, inclusive”• “WBS2 was severely impacted from Apr to July 2020, inclusive”• “WBS1 was moderately impacted from Sep 2020 to task

completion in Jan 2021”• “WBS2 was moderately impacted from August 2020 to task

completion in May 2021”

• DD 1921 (annual reports)o Report-level and WBS-level Remarks

• IPMDARo Report-level and WBS-level Format 5 Variance Reports,

allow for more detailed/nuanced explanations• FlexFiles

o Unlike Remarks, which have to be manually “extracted,” new tags and Additional Data Fields can be pivoted to more easily isolate and analyze data

PRE-DECISIONAL

Phase Data Type WBS1 WBS2baseline start date 07/01/19 01/01/20baseline duration (mo) 12 12baseline finish date 07/01/20 01/01/21baseline BAC ($) $1.2M $2.4Mbaseline burn rate ($/mo) $0.1M $0.2Mbaseline SPI 1.00 1.00pre-crisis duration (mo) 12 12pre-crisis burn rate ($/mo) $0.1M $0.2Mpre-crisis EAC (CPI) $1.3M $2.7Mcrisis disruption start 03/01/20 04/01/20crisis time elapsed (mo) 8 3crisis stop work duration (mo) 6 4disruption cost efficiency 80% 85%disruption schedule efficiency 90% 95%

Presenter

Presentation Notes

Need to address impact models, backward-looking estimates. “Cost is an unrepeatable experiment.” Government prerogative to normalize and analyze historical data, but will “take under advisement” inputs from Industry. Industry may need to provide a “BOE” for things like REAs and Insurance claims. Universal CPI after vs. CPI before approach (Carl Perry, et al.). John Felshaw (BDS) idea of dummy variable.

19

CCDR Specifics – Cost Structures

• Direct and Indirect Costso “Would Have Been” Cost (can be estimated, not known)o With COVID-19 Impacts Cost

DAU Webcast

Direct1

Direct2

Directn

WBS1

WBS2

WBSn

OH1

OH2

OHn

Direct1

Direct2

Directn

WBS1

WBS2

WBSn

+

+

+

OH1 +

OH2 +

OHn +

Direct1

Direct2

Directn

WBS1

WBS2

WBSn

OH1

OH2

OHn

WBSn+1 + + + + + +

Not recommended!

Post-Crisis (2 methods)

Method 1 (costs distributed to applicable

WBS elements)

Method 2 (new WBS elements capturing

impacts)

Pre-Crisis

Most Direct Costs likely not separable

+ + +

Most Indirect Costs likely separable

Presenter

Presentation Notes

CPI before vs. CPI after. Or EAC before vs. ACWP final after.

20

CCDR Specifics – Scenarios and Impacts (Examples)DAU Webcast

Example Scenario Impact

Total Labor Hours

Direct Labor Rate

Overhead Rate

MaterialCosts

Touch Labor SEPM

QuantityInfo

Temporary closures or furlough

Production sequence interrupted X X X

Period of performanceextended X X

Supply chain delays X X

Loss of learning X X

Direct/fringe rates increase X

Plant reconfiguration, increased security andhealth measures

Out-of-sequence work X X

Overhead increase X

Loss of learning X X

Components of Cost

It is possible to “opt in” to FlexFiles if it makes COVID-19 reporting easier!21

CCDR Specifics – Reporting MechanismsDAU Webcast

Remarks (minimum requirement)All formats• Contractor, at a minimum, can provide detailed remarks describing the type and timing of all impacts• More general impacts can be described in the Summary Remarks• If an impact is specific to certain WBS Elements or Functional Elements, then those can be described in the WBS Element Remarks (present in the 1921-1,

FlexFile, and Quantity Data Report only) • Other comments can include explaining the use of new charge codes, work packages, control accounts, pricing categories, or other methods to explicitly

capture impacts as a result of COVID-19

Including New WBS Elements in the ReportFlexFile/Quantity Data Report and Legacy 1921 Forms• It could make sense to include a new WBS Element to segregate types of cost as a result of certain impacts (e.g., CARES Act Section 3610)• Would require a Plan Revision and potentially a contract mod

Including New Tags in the ReportFlexFile and new 1921-3 only• If a contractor uses a new charge code, work package, control account, pricing category (direct or overhead), etc., to track impacts then these new tags should

appear in the FlexFile or 1921-3• If the contractor is reporting a FlexFile, the new charge codes, control accounts, etc., will appear in the Account data field, depending on what they are using

to satisfy that requirement• Same applies to new pricing categories with the Functional Category and Functional Overhead Category data fields• The new 1921-3 format allows for inclusion of contractor specific categories so any new pricing categories established should be included in the report

Including New Data Fields in the ReportFlexFile Only• If a contractor establishes a new data field in their systems to track impacts, then this can be added to the FlexFile as an Additional Data Field #1-#12• Would require a Plan Revision and potentially a contract mod

Presenter

Presentation Notes

Additional Data Field could be binary (1 = COVID-19 vs. 0 = non COVID-19) or ordinal (no impact, moderate impact, severe impact,…).


FlexFiles Overview & Status

23

Presenter

Presentation Notes

Poll Title: How much do you currently know about FlexFiles?https://www.polleverywhere.com/multiple_choice_polls/QBqNyHUJVY6ihKeTrBXdM

24

Flex

File

/Qua

ntity

Dat

a Re

port

From five DIDs to two

CWBS Index and Dictionary

1921: Cost Data Summary Report

1921-1: Functional Cost-Hour Report

1921-2: Progress Curve Report

1921-5: Sustainment Functional Cost-Hour Report

From Five DIDs to Two

25

Data Group BDD Form 2794 Data ElementsWBS ElementOrder/LotEnd Item

Data Group AReport MetadataApproved Plan NumberSubmission EventPeriod of PerformanceReporting OrganizationAs of DateDate Preparedmore in the DID…

Data Group CDefinitions and RemarksWBS Element DefinitionsRemarks by WBS ElementSummary Remarks

Data Group EActuals To Date (ATD)AccountReporting PeriodCLINNonrecurring or RecurringFunctional Category / OverheadStandard Functional CategoryUnit/SublotWBS ElementOrder/Lot and End ItemATD (Dollars and Labor Hours)

Data Group DSummary ElementsOrder/LotSubtotalGeneral and AdministrativeUndistributed BudgetManagement ReserveFacilities Capital Cost of MoneyContract FeeContract Price

Data Group FAllocation MethodologyAllocation Method

Data Group GForecasts At Completion (FAC)FAC (Dollars)FAC (Labor Hours)

Legacy Element

The core of the FlexFile is providing dollars and hours at the account level in contractornative categories, time phased.

Insight into contractor’s native Functional Categories

Account level reporting at or below the WBS

Data time-phased monthly or to align with contractor’s financial calendar

Continuity with prior reports by requiring the legacy government tags

Greatest value to cost estimator, in many cases, will be the additional insight requested in Group E

FlexFile Data Groups

FlexFile Submission Options

26

Contractor submits the FlexFile and Quantity Data Report in their own format, so long as it adheres to the DID and approved CSDR Plan

Contractor submits the FlexFile and Quantity Data Report utilizing an Excel template that mirrors the File Format Specifications (FFS)*

Contractor submits the FlexFile and Quantity Data Report in the data model according to the File Format Specifications (FFS)

Contractor has three options to submit the data in….

The following documents provide additional details regarding the submission mechanisms and processes

FlexFile and Quantity Data Report DIDs Implementation Guide Date Exchange Instructions (DEI) File Format Specifications (FFS) Excel-Compatible File Guidance New DD Form 2794 Format

All documents can be found at…https://cade.osd.mil/policy/flexfile

*Same options apply to the Quantity Data Report, except there is only a one part template, as opposed to three.

https://cade.osd.mil/policy/flexfile

27

Contractor is ready to submit

Finalized*

SR Validation

*Unless another iteration is necessary

Ingested in Submit Review Data Gymnastics

Contractor submits report regardless of file type and receives receipt of submission

CWIPT can provide feedback at any point after the contractor submits

Submission will follow the normal workflow if submitted using the JSON Data Model or Three Part Template

If the file is submitted in Contractor Format, then additional time will be allotted to ensure that...o File is compliant with the DID and approved CSDR Plano File can be organized into the JSON Data Model

CWIPT will receive notification from DCARC once the contractor formatted file is organized in the JSON Data Model

DCARC Only

actions performedcPet or SR Conversion

Contractor uploads file

FlexFile Submission Workflow

28

Equal Distribution Between Template and Contractor Format

29

Air Force Programs Have Provided the Most FlexFiles

30

FlexFile CADE Exports

FlexFile Pivot ExportFlatfile of the FlexFile actual dollars and hours according to Data Group E

FlexFile Template ExportExcel version of the data model structure outlined by the FFS

Formatted and Flat File 1921Equivalent of the 1921 DD Form and 1921 flatfile

JSON Data ModelAccording to the FFS

Contractor Submitted Files*Three Part Template, Contractor Format, or similar structure

Validation Error ReportDocument used to communicate CWIPT feedback to the contractor

DCARC DocumentationDescription of how DCARC interpreted Contractor Format submission

31

130 Additional FlexFiles Expected This Year

Nearly 250 CSDR plans with FlexFile reporting have been approved


24 June 2020

Data & Analytics Demo


TrainingOpportunities

35

All documents can be found athttps://cade.osd.mil/policy/flexfile/

FlexFile and Quantity Data Report DIDs Implementation Guide Date Exchange Instructions (DEI) File Format Specifications (FFS) New DD Form 2794 Format Draft CDRL Language

See https://cade.osd.mil/support for training material and information on upcoming training events

CDSG/DCARC DirectorMr. Kelly [email protected](703) 614-5397

DCARC LeadMr. Brian [email protected](571) 372-4259

Training & Outreach LeadMr. Torri [email protected](571) 372-4270

FlexFile LeadMr. Marc [email protected](703) 697-0362

Points of Contact

Important Documents and POCsFlexFile 101

https://cade.osd.mil/policy/flexfile/

https://cade.osd.mil/support

mailto:[email protected]





Back Up

Update to DoDI 5000.73MAJOR CAPABILITY ACQUISITION• CAPE conducts or approves independent cost estimates (ICEs) for MDAPs and major subprograms prior to: Milestone A Milestone B Low rate initial production Full rate production At any other time considered appropriate by DCAPE Upon the request of USD(A&S) or the milestone decision authority

• CAPE may conduct or approve an ICE or cost analysis to inform the Development Request for Proposal Release Decision Point

• At the discretion of DCAPE or upon the request of the Secretary of the Military Department, CAPE conducts or approves ICEs for sustainment reviews

• CAPE conducts independent cost analysis for certifications following critical Nunn-McCurdy breaches

• CAPE conducts a preliminary cost analysis and final cost analysis for multiyear procurement contracts

37

2020 Update to DoDI 5000.73

MIDDLE TIER OF ACQUISITION

• Rapid Prototyping Programs CAPE or Service Cost Agency (SCA) conducts life-cycle cost estimates for

programs likely to exceed acquisition category (ACAT) I thresholds Estimates for programs that do not exceed the ACAT I threshold must be

conducted in accordance with guidance issued by the relevant SCA

• Rapid Fielding Programs CAPE or the SCA conducts life-cycle cost estimates for programs likely to

exceed ACAT I or II thresholds DoD Components must conduct life cycle cost estimates for rapid fielding

programs that do not exceed the ACAT II threshold in accordance with guidance issued by the relevant SCA

38

Update to DoDI 5000.732020 Update to DoDI 5000.73

SOFTWARE

• CAPE or the SCA must conduct an ICE for programs likely to exceed ACAT I or II thresholds prior to the program entering the execution phase

• The ICE may be updated during the execution phase• Estimates for programs that do not exceed ACAT II thresholds must be conducted

in accordance with the policies and procedures issued by the SCA

DEFENSE BUSINESS SYSTEMS

• CAPE may conduct a cost estimate for defense business systems• For all other defense business systems, the SCA or designated organization will

conduct cost analyses in accordance with guidance issued by the SCA

CONTRACTED SERVICES

• CAPE may conduct a cost estimate for acquisition of a contracted service• All other cost estimates for contracted services must be conducted in accordance

with the policies and procedures issued by the SCA

39

Update to DoDI 5000.732020 Update to DoDI 5000.73

Department Addressing COVID-19

Defense Pricing and Contracting (DPC)• DPC has issued a number of memoranda in response to COVID-19• Most notably:

• [09 Apr] Implementation guidance for Section 3610 of the CARES Act – how to recover costs via requests for equitable adjustment (REA) by contract type (Fixed Price, Cost Plus, T&M)

• [06 Apr] Change to the Delegation of Authority for Use of Other Transactions for Prototype Projects in Response to Coronavirus Disease 2019

• [30 Mar] Managing Defense Contracts Impacts of the Novel Coronavirus – addresses equitable adjustments as a response to contract impacts caused by COVID-19

• https://www.acq.osd.mil/dpap/pacc/cc/COVID-19.html

Coronavirus Aid, Relief, and Economic Security (CARES) Act• SECTION 3610, FEDERAL CONTRACTOR AUTHORITY• States that funds from this or any other Act can be used to “modify the terms and conditions of a

contract…to reimburse at the minimum applicable contract billing rates not to exceed an average of 40 hours per week any paid leave, including sick leave, a contract provides to keep its employees or subcontractors in a ready state…”

Data-Driven Estimating OS4703 Applied Cost Analysis

40Untangling COVID-19 impacts will be a significant effort going forward

Presenter

Presentation Notes

$6M / 24 months = $250K/month.

https://www.acq.osd.mil/dpap/pacc/cc/COVID-19.html


24 June 2020

Data & Analytics Overview

Data and Analytics RedesignCADE Data & Analytics Overview

• A new design for the Data and Analytics home page was published on 05 Dec 2018• It is intended to better support two primary modes of accessing data

• Browse Data Across Programs: Aggregate data from multiple Tasks/Contracts/Programs

• Think “analysis-ready flat files”

• Data by Program: Drill-down by Program, Contract, and Task• Think “standard reporting formats”

The Artist Formerly Known As Cross-Program Query has been appropriately

renamed

42

Multiple CSDRs – Flexible SearchCADE Data & Analytics Overview

• The Browse CSDR Submissions function provides a more flexible “DACIMS-like” search/browse

• Simultaneously locate and download multiple CSDRs• Works with any mix of Contractor Cost Data Reports

(CCDRs) and Software Resources Data Reports (SRDRs)

• Access to all contract-specific 1921-series forms• CDSR (1921), FCHR (1921-1), PCR (1921-2),

Sustainment FCHR (1921-5)• Includes FlexFiles!

• CCDRs are available as both “formatted” and flat file downloads

43

Choose Browse CSDR Submissions from the Data and Analytics home page…

…or from the Data menu

Browse CSDR Submissions DetailsCADE Data & Analytics Overview

Apply filters to narrow down search, including Report Type

44

Use Report Type to select CCDR or SRDR…

Running tally of Reports that match

filter criteria

Specify whether to include non-flat-file-exportable reports

…then use Report Type column header to

isolate specific types (e.g., FlexFile, SRDR

Initial)

45

Data Access – CSDR-SRCADE 201

Export Excel Data Model TemplateFlexFile data provided in Excel data model structure

Export Pivot DataActual dollars and labor hours according to the data elements in Data Group E of the approved FlexFile DID

Formatted File ExportExcel version of formatted 1921 DD Form

Export to Excel Excel flat file with Metadata, Remarks, and Definitions equivalent to that provided in the 1921 DD Form

An analyst can access a FlexFile in the CSDR-SR in four primary ways…

1

2

3

4

3

2

4

1

46

Retrieving FlexFilesCADE 201

Step 1: Navigate to the FlexFile submission. File submitted in JSON. To pull the file go to the Validation tab

Step 2: At the bottom of this page under Validate: Review Results you will have the options to download the FlexFile Excel Template or FlexFile Pivot Data

Step 3: Downloaded files will be stored under My CSDR -> Retrieve Files

47

Data Access – Data and AnalyticsImplementation Overview

FlexFiles can be accessed using the Browse CSDR Submissions feature in Data & AnalyticsUtilize filters to narrow search results > select submission event.

CADE 201

FlexFile Exports

FlexFile Pivot Export flattens (de-normalizes) the structured data in the FlexFile• Supports filtering & pivot table

creation• Repeat values on every row (de-

normalized)• Requires familiarity to source/intent of

specific columns

FlexFile Template Export • FlexFile data provided in Excel data

model structure

48

CADE 201

FlexFile ExportsFlexFile Pivot Export will produce a zip file containing FF Pivot Data Export & New Pivot Table Template

• Excel workbook “shell” containing pre-formatted pivot tables • Configured with an “External Data Connection” that can point to a FF CSV File

FlexFile Example File Is 215,000 Rows; Refresh Time Approximately 15 SecondsPivot Data is typically very large; may not fit in excel 49

Data and Analytics Landing PageCADE Data & Analytics Overview

50

Drill-down by Program, Contract & Task

Aggregated data from multiple Tasks/Contracts/Programs

• A new design for the Data and Analytics home page was published on 05 Dec 2018

• It is intended to better support two primary modes of accessing data

• Browse Data Across Programs: Aggregate data from multiple Tasks/Contracts/Programs

• Think “analysis-ready flat files”

• Data by Program: Drill-down by Program, Contract, and Task

• Think “standard reporting formats”

Multiple CSDRs – Flexible SearchCADE Data & Analytics Overview

• The Browse CSDR Submissions function provides a more flexible “DACIMS-like” search/browse

• Simultaneously locate and download multiple CSDRs

• Works with any mix of Contractor Cost Data Reports (CCDRs) and Software Resources Data Reports (SRDRs)

• Access to all contract-specific 1921-series forms• CDSR (1921), FCHR (1921-1), PCR (1921-2),

Sustainment FCHR (1921-5)• Includes FlexFiles!

• CCDRs are available as both “formatted” and flat file downloads

51

Choose Browse CSDR Submissions from the Data and Analytics home page…

…or from the Data menu

Browse CSDR SubmissionsCADE Data & Analytics Overview

• Apply filters to narrow down search

52

Running tally of Submissions that

match filter criteria

Use Report Type to select CCDR, SRDR or CWBS Dictionary

Specify whether to apply search results to WBS elements; Include/exclude Legacy (non-flat-file-exportable submissions)

Enter any keyword or keyword combination (FlexFile, PMP (i.e., radar))

Export submission metadata and download native files

Browse CSDR Submissions Details PageCADE Data & Analytics Overview

53

Export native files

Download FlexFile Pivot & Excel Template Export (excel data model

structure) from Retrieve Files

Download excel version of formatted 1921 & flat file export

(metadata, remarks & definitions)

Bulk download submission files

Presenter

Presentation Notes

Export Excel Data Model Template FlexFile data provided in Excel data model structure Export Pivot Data Actual dollars and labor hours according to the data elements in Data Group E of the approved FlexFile DID Formatted File Export Excel version of formatted 1921 DD Form Export to Excel Excel flat file with Metadata, Remarks, and Definitions equivalent to that provided in the 1921 DD Form

CADE 201

Cross-Program Query

Default screen is Favorites(shown) or Search Programs (if

no Favorites selected yet) or Dashboard (if exactly one

Favorite)

Choose Search Cross-Program Data (aka Cross-

Program Query)

54

Step 1: Cross-Program Query

CADE 201

Cross-Program QueryRecommend using Chrome or

Edge to access FACADE! Certain locations block the fonts needed

for it to render properly

Favorite blue stars are not visible, though the toggle functionality is still there Data Availability green

checkmarks and red Xs are not visible

55

Step 1: Known Font Issues

CADE 201

Cross-Program Query

Displays total number of CCDRs

in FACADE

Initially, no Filters have yet been applied

Choose Edit/Run

56

Step 2: Start Query

CADE 201

Cross-Program Query

Check all desired options for given filter

Choose any of various filters from the Add

Filter drop-down

57

Step 3: Initial Filter

CADE 201

Cross-Program Query

Number of CCDRs included decreases

based on filter

First filter now identified in table

Choose an additional filter from remaining choices on the Add

Filter drop-down and check the desired

options

58

Step 4: Initial Filter Results

CADE 201

Cross-Program Query

Number of CCDRs included further

reduced

Additional filter now identified in table

Choices for each new filter based on

cumulative effect of previous filters – order

matters!

Step 5: Final Filter

CADE 201

Cross-Program Query

Final filter now identified in table

Click Run to generate

filter results

Results table shows metadata for all

reports identified

60

Step 6: Run Query

CADE 201

Cross-Program Query

Use Include All and Exclude All to toggle

reports en masse

61

Step 7: Manual Down-Select

CADE 201

Cross-Program Query

Select or de-select individual reports by

clicking in the leftmost column

Click Export once reports are selected

62

Step 7: Manual Down-Select

CADE 201

Cross-Program Query

Click Export

Select Functional Cost and Hours (“mash-up” of

1921 and 1921-1 data) and Progress Curve(1921-2), if available

Give Export a name

(required)

Pop-up shows Export options

63

Step 8: Export

CADE 201

Cross-Program Query

Click OK to confirm export

64

Step 8: Export

CADE 201

Cross-Program Query

Choose Save…

…and click Save

…name query…

Query now shows by name

65

Step 9: Save Query

CADE 201

Cross-Program QueryClick on RETRIEVE

FILES

Click Refresh Status of Files if needed, until

Current Status column shows Finished

Click to download

Save and Extractzip file

Open Excel file and Enable Editing

66

Step 10: Retrieve Export

CADE 201

Cross-Program Query

Click DATA – Filter to apply filter

67

Step 11: Flat File

CADE 201

Cross-Program Query

Use WBS Element Concatenate field filter to select desired element(s)

Filtering for At Completion and

Recurring further reduces number of rows

Filter status shows reduction in number of

rows (records)

Unit of Measure can be used to isolate Quantity, Cost (TY $K), and Hours

68

Step 12: Excel Filter


Bridge: CADE’s Learning Management System

Why Use Bridge? (https://cade.bridgeapp.com)Bridge Learning Management System

• Online Learningo Bridge allows you to take full

CADE Training programs from your computer or mobile device wherever you are

• Live Trainingo Sign up for live training events,

access course materials, and participate in class activities

• Resourceso A variety of resources to help you

with all your CADE needs

What Full Courses Are Available?Bridge Learning Management System

CADE 201 coming soon!

Ready To Get Started?Bridge Learning Management System

• Log In at https://cade.bridgeapp.com

• Need Help Logging In?o Contact Jack Titus at

[email protected] or Ryan Horn at [email protected]

• Need An Account?o Sign up at

https://cade.osd.mil/support

