chains and processes to facilitate transparency between ... · data center • framework for...
TRANSCRIPT
Chains and processes to facilitate transparency between government agencies and the public.
The Single Window; Dutch customs use case
Asish Dash, CTOMarnix Vermaas, Business Architect
About us• Qualified information exchange,
established in 2006
• Responsible for services provided to governments world wide
• Service the complete delivery from idea to operations using open standards and secured protocols
• We embrace laws and regulations.
What is the concept of Single Window?Drivers:
• In line with EU regulations• EU Directive (2010/65/EU)
• Streamline the Dutch economy• Import value (2017):
400,000 million euros• Export value (2017):
450,000 million euros• Automate complex border
processing• Share required information
between agencies • Standardise and harmonise
What is the concept of Single Window?Stakeholders:
• Four Dutch Ministries• Several Dutch Sea Ports
including Rotterdam (largest port in Europe)
• Schiphol Airport (3rd largest in Europe)
• Various companies, Consortiums, Community hubs, networks, etc. (over 1500 parties)
What is the concept of Single Window?Scope of Interaction:
• All border formalities:• Port entry• Cargo• Health and Safety• Border Security
• Maritime and Air transport
Standards:
• WCO semantic model• XML/EDIFACT• SMTP
Where do the messages go?
Single Window
Customs
Immigrations
Where do the messages go?
Single Window
Customs
Immigrations
Where do the messages go?
Single Window
Customs
Immigrations
Why is it important globally?
EU Single Window
What’s our situation?March 2016
Customs Declaration Platform
• Legacy, as-is migration to our platform
• 1-to-1 messages (to Customs)
September 2016
Maritime Single Window MSW
• 1-to-many messages
• Compliant by Design
• WCO Semantic model
• Dutch sea ports connected, incRotterdam
June 2017
Generic Single Window SW
• Dutch airports connected, incSchiphol
• EDIFACT/XML conversion
• Single point of contact for all Dutch border formalities
Aug 2018
Increased volumes, More standards
• More businesses connected
• Business 2 Government (B2G) – 80,000 messages per day (MPD)
• Government 2 Business (G2B) –40,000 messages per day (MPD)
Why did we select TIBCO?
• Onboarding experience• Our team actually enjoys working with and
supporting connecting parties
• Support of Active-Active maintenance• This infrastructure and setup is being used as a
blueprint for other government deployments
• Built-in monitoring of connection points• At a technical and functional level, made our life
easier.
What TIBCO products do we use?
TIBCO BW & BC
• Government transaction gateway for chain processing
TIBCO BW, RV, EMS
• Integration and scalability
How do we use our TIBCO products?
SOAPSOAP
TESTING STUB
ESB ROUTERPOSTFIX
MTAPOSTFIX
Adapter
SMTP-MTA
SMTP Service
Generic Service
(e.g. WUS)
SMTP
• 10K bus messages per minute• 10 TIBCO nodes (BW, RV, EMS)• 30% burst
• No issues at burst• No issue with sustaining burst
POSTFIX
MSA
SMTPPOP3
TERMINOLOGY• MSA – Mail Submission
Agent for mailclient to SMTP server
• MTA – Mail Transmission Agent for machine to machine SMTP traffic
• POSTFIX – Mail Server• WUS – WSDL, UDDI,
SOAP
TECHNICAL CHALLENGES:• Timelines• Burst traffic• 0 down time, 0 loss of
messages, 15s guaranteed delivery
What success looks like Mar 2016 Business
• Platform migration as-is
• Virtually no impact on businesses
• Customs Declarations
INBOUND
DC1 DC2
HTTPSRV1
HTTPSRV2
HTTPSRV3
HTTPSRV4
DB 1 DB 2 DB 3 DB 4
APP SRV2
APP SRV1
APP SRV3
APP SRV5
APP SRV4
APP SRV6
Technical
• Seamless transition from previous system
• Support for blue-green maintenance
• INBOUND fully load balanced and fault tolerant (combination of BC interior, BC exterior, MFT)
• NFS tuned and developed in datacenter to support I/O requirements
What success looks like Sep 2016 Business
• 3 Port Hubs
• Customs, Border Control, SafeSeaNet
• OTP starts transition to Single Window
• B2G – 200 MPD
• G2B – 100 MPD
Technical
• Enhanced monitoring
• Technical
• Functional
• E2E
• Performance tuning based on this monitored data
Go to cool animation …
Enhanced monitoring
Single Window
Customs
Immigrations
1A
1B
2A
2B
3A
3B
E2E
Enhanced monitoring
Single Window
Customs
Immigrations
1A
1B
2A
2B
3A
3B
FunctionalTimingsRepliesTracking
DiskCPURAM
Network
Technical
What success looks like Jun 2017 Business
• Air traffic and cargo messages
• Send and receive in EDIFACT
• B2G – 7,000 MPD
• G2B – 5,000 MPD
Technical
• Automatic databases failover in one data center
• Double management LAN from second data center
• Framework for automatic startup of environments
INBOUND
DC1 DC2
HTTPSRV1
HTTPSRV2
HTTPSRV3
HTTPSRV4
DB 1 DB 2 DB 3 DB 4
APP SRV2
APP SRV1
APP SRV3
APP SRV5
APP SRV4
APP SRV6
DB 2
What success looks like Jun 2017 Business
• Air traffic and cargo messages
• Send and receive in EDIFACT
• B2G – 7,000 MPD
• G2B – 5,000 MPD
Technical
• Automatic databases failover in one data center
• Double management LAN from second data center
• Framework for automatic startup of environments
INBOUND
DC1 DC2
HTTPSRV1
HTTPSRV2
HTTPSRV3
HTTPSRV4
DB 1 DB 2 DB 3 DB 4
APP SRV2
APP SRV1
APP SRV3
APP SRV5
APP SRV4
APP SRV6MG
T SR
V1
DB 2 DB 3 DB 4
What success looks like Jun 2017 Business
• Air traffic and cargo messages
• Send and receive in EDIFACT
• B2G – 7,000 MPD
• G2B – 5,000 MPD
Technical
• Automatic databases failover in one data center
• Double management LAN from second data center
• Framework for automatic startup of environments
INBOUND
DC1 DC2
HTTPSRV1
HTTPSRV2
HTTPSRV3
HTTPSRV4
DB 1 DB 2 DB 3 DB 4
APP SRV2
APP SRV1
APP SRV3
APP SRV5
APP SRV4
APP SRV6MG
T SR
V1
MG
T SR
V2
Lessons LearnedData synchronization is a problem
• DB data synchronization and latency (amount of data, pipe saturation, errors, etc)
Infrastructure fails
• Hardware fails, networks go down, KPIs not met, Hacks and attacks
Actively put in monitoring on day 1
• Don’t assume out of the box monitoring will meet your needs. Functional (individual component/service), Technical (middleware down) and E2E chain (message flow) need to be viewed in a consolidated place.
Equal partners, conflicting interests
• How to build trust and confidence
What success looks like next year?Tackling BREXIT
• 35,000 companies affected:
• More connected parties
• Message volume growth:
• B2G – 120, 000 MPD
• G2B – 60, 000 MPD
One Single Window to rule them all
• Interconnecting national Single Windows
• Additional: Tracking Cargo, Modes of transport and sharing Documentation
EU Single Window
What else do we do with TIBCO?Dutch Tax Declarations
• For Companies and Citizens
• Standard Business Reporting (SBR), Extensible Business Reporting Language (XBRL)
E-Government/GLOBE
• National platform for all communications from Government to Citizen (replacing all paper)
FinTech
• Certified SWIFT Service Bureau, PSD2
• Government transaction gateway for national financial transactions
What’s next?Improve our architecture
• APACHE kafka (as part of SMACK stack)
• Autoscaling
• Hyperledger
Hackathons
• Identities on Blockchain
• Fraud detection/universal track-and-trace
More industries, more …:
• Health and Safety
• Statistics Office
• Housing Authority
• Financial SWIFT transactions
• Personal Data Management (GDPR)
Questions…• EBPI - https://www.ebpi.nl/
• Hyper42 - https://www.hyper42.eu/
• Blockchaingers Hack-a-thon - https://blockchaingers.org/teams-2018/hyper42
• Dutch Customs Single Window -https://www.belastingdienst.nl/wps/wcm/connect/bldcontenten/belastingdienst/customs/reference_books_and_other_information/single-window/
• EBPI’s news on the launch of Single Window - https://www.ebpi.nl/over-ons/single-window/