Understanding Integration Cloud and how to get the most out of your implementation

Category: General Updates Page 4 of 5

OIC Scheduling for End of Month style processes – Tip #11

Setting up calendar schedules that aren’t simply reoccurring, such as a specific date in a month like 28th or third Friday, become more of a challenge with the OIC Scheduler. The calendar works with the ical standard set by the IETF standard 2445. If you review the standard’s section 4.3.0, this describes the reoccurrence options, whilst able, not able to address these needs.

Reoccurring on specific dates can, in theory, be set. If you review section 4.3.4, you will see a date has the potential to be defined as a comma-separated list. So multiple dates for month-end can be provided as a list. Note, this is predicated on the calendar attribute supporting date-mday (DATE). The DTSTART and DTEND attributes accept DATE with no indication that the date-mday is not supported.

Specifying the dates explicitly overcomes the problems of national holidays. The downside is that you need to know when the list needs to be extended and, in the case of OIC, the means to edit the scheduler format safely.

NOTE: we have not tested whether the OIC scheduler is compliant with the use of date-mday at the time of writing.

Versions 1 and 2 running concurrently

Complex formulas for scheduling and more manageable scheduling..

There are several options for managing reoccurring events, such as month-end, year-end accounting, payroll and expenses payments etc.

In most options, we assume that we have a simple reoccurring schedule that triggers an integration that determines whether the trigger is legitimate. This could be as simple as daily. If valid, then invoking the main integration with the business process.

Defining Dates in the database, we can wrap it with JET, Visual Builder or APEX to create a presentation layer. The task of managing the schedule to be taken on by the business.

This approach makes it very easy to adjust and test. Whether there are any more future schedule dates can also be overcome by having an integration that queries the table for the next date being set. If not date set, then the generate relevant alerts using OCI native tools.

The schedule is triggered regularly, e.g. daily, and the scheduler trigger invokes an integration then looks up the DB to see if the date appears in the list. When the date appears, then the integration is executed. It would be straightforward to extend this to trigger different schedules.

Automated option

If an algorithm can be described for when the month-end processes should be performed, we eliminate the need to manage a list of dates. There are some ways to implement a formula, and you have the option of trying to do it OIC, but using OCI Functions – the formula is coded in the language of your choice and then packaged and deployed. The Function is then invoked using a REST web service to confirm whether the process should run (more on how here).

Handling public and national holidays. Not all national holidays are locked into an algorithm, or the holiday is fairly complex. That said, there are several API sources available that can tell you these dates, for example, https://holidayapi.com; this makes things easier.

The beauty of this process is that the same Function could keep a company website up to date with the next run date. Be integrated into corporate notifications and so on. As a result, one point of truth.

Enhanced Automation (feature wish …)

Unfortunately, OIC doesn’t provide an API to add new schedules. We can’t simplify the integration logic until it does, which adds the next calculated date for the process to run as a one-off schedule.

iCal Resources (inc Tools)

July 21 – New OIC articles

Article / LinkAuthorSubject MatterConnecting
Oracle Integration Cloud (OIC) & octet-stream MIME-typeAmy Simpson-GrangeOIC 
delete a schedule from an IntegrationKabir YadavOIC 
How Granular Should My Microprocesses Be?Jan KettenisPCS 
How to perform FBDI GL File UploadDeb MukherjeeOIC 
Load FBDI and callbackDeb MukherjeeOIC 
Basic File Encryption and Decryption in OICDeb MukherjeeOIC 
Oracle Digital Assistant – Backend Integration with the Oracle Integration CloudDaniel TeixeiraOICODA
Oracle Integration Message Packs and PricingAnkur JainOIC 
Business Identifiers in Oracle IntegrationAnkur JainOIC 
FlexDeploy Support for Oracle CloudJurgen KressOICCI/CD
OIC & Blue Prism Part 1, Part 2Niall CommiskeyOICBlue Prism (RPA)
August 2021 Oracle Integration UpdateAntony ReynoldsOIC 
OIC Monitoring and Logging Analytics – adding Business Data to DashboardsNiall CommiskeyOICLog Analytics
OIC and Logging Analytics – steps towards fleet management and more stepsNiall CommiskeyOICLog Analytics
Logging Analytics for OICNiall CommiskeyOICLog Analytics
Event Driven Integration with Oracle Commerce CloudNiall CommiskeyOICCommerce Cloud
Turning SFTP Cloud NativeJohan LouwersOIC 
Authenticating Oracle Integration flows using OAuth token from 3rd party providerPrakash MasandOICOAuth
August 2021 New Third Party Application AdaptersPrakash MasandOICSAP, Zendesk

June 21 – New OIC articles

It appears to have been an unusually quiet month, but that could be a reflection of the OIC release cycle as we’ll probably hear about the next feature set updates late in July.

Article / LinkAuthorSubject MatterConnecting
OIC Recipe – SFDC Opportunity to Fusion ERP OrderNiall CommiskeyOICSFDC, ERP
Some Ideas for OIC Fleet ManagementNiall CommiskeyOIC 
OIC – SFDC -Bulk apiNiall CommiskeyOICSFDC
Improving the performance of Oracle Integration flows that use REST callsNick MontoyaOIC 
Connecting securely from Oracle Integration to Autonomous database using network access listShreenidhi RaghuramOICADB
Connect Oracle SaaS (ERP, HCM, CX) with Pre-Built Recipes – Accenture Oracle WebcastJürgen KressOICERP, HCM, CX 
Insight Mapping ImprovementsSanthosh KumarInsights 
Real time Synchronization of Suppliers leveraging Event Driven ArchitectureKishore KattaOICKafka
Oracle HCM Cloud – Payroll Sync with the Oracle Integration CloudDaniel TeixeiraOICHCM
Using REST APIs to manage Connections in OICPranav DavarOIC 
Enable Business Events for Payables Business Events/Payments in Oracle Fusion Finance CloudDeb MukherjeeOICERP
OIC – API Gateway – Logging –> the value add of OCINiall CommiskeyOICOCI (API, Logging etc)
Configuring Notifications in Oracle Integration Gen2Lavanya SiliveriOICOCI Email
Use Oracle Integration to Add Attachments to a Process InstanceBogdan EremiaOIC 
File Adapter Vs FTP Adapter in Oracle Integration CloudAnupam BartwalOIC
Oracle Integration Cloud (OIC) AdaptersKrishan KumarOIC

May 21 – New OIC articles

Article / LinkAuthorSubject MatterConnecting
Integrate ICS with a third party OAuth Protected REST service using the generic REST adapter (Part 2) (Part 1)Anuj KaushalOIC 
Oracle Integration Latest FeaturesAntony ReynoldsOIC 
Integration Insight for Process automationSandhya Lakshmi GopalanPCS, Insights 
DevOps and Release Automation for Oracle Integration Cloud – Webcast May 13th 2021Juergen KressOICFlexDeploy
Help! I can’t find my OIC instances anymoreSimone GeibOIC 
May 2021 Oracle Integration Enterprise Messaging Adapters ImprovementsPrakash MasandOICMessaging
May 2021 Oracle Integration Fusion Application Adapters ImprovementsPrakash MasandOICApps
May 2021 Oracle Integration Database Adapter ImprovementsPrakash MasandOICDB
Oracle Integration Cloud – Kafka Adapter with Apache AVRODaniel TeixeiraOICKafka
Process Automation with Process Cloud Service (PCS) – Part 5 – (Publish & Activate) (Part 1, Part2, Part3, Part4)Daniel TeixeiraPCS 
Integration Insight – Business Analytics for the Oracle Integration CloudDaniel TeixeiraOIC, Insights 
Private connectivity to Oracle Integration Cloud next generationOmid IzadkhastiOIC 
Package in OIC |Add package for IntegrationKabir YadavOIC 
Package Migration or Multiple Integration Migration |OIC Integration MigrationKabir YadavOIC 
Run OIC scheduled integration using RESTAnkur JainOIC 
OIC Connectivity Agent PatternsNiall CommiskeyOIC 
SOA Suite to OIC – how easy is it? Part 1 Part 2 Part 3Niall CommiskeyOICSOA Suite
New Recipes – FTP to Netsuite File CabinetNiall CommiskeyOICNetSuite
ATP Bulk Data ImportNiall CommiskeyOICATP
Integration Insight AlertsNiall CommiskeyInsights 
Integration Insight -> embed Dashboards in Visual BuilderNiall CommiskeyInsights 
Process & Integration InsightNiall CommiskeyInsights, PCS 
B2B support for UN EDIFACT Part 1, Part 2Niall CommiskeyOIC 

Reflecting on community

If you’ve attended an Oracle conference or just aware of the wider Oracle ecosystem, then you’ll know of the Oracle APEX community and probably one of the communities’ highly respected and much-loved contributors, Joel Kallman. Sadly, Joel has passed on, another victim of Covid19. Our thoughts go out to Joel’s family and the community who have lost someone they value so much.

https://apex.oracle.com/pls/apex/apex_pm/r/joel/memories

March 21 – New OIC articles

Time flies, with a 1/4 of a year behind us already including the first quarterly release. Last month we’ve seen a lot of attention around Oracle Hospitality Integration Platform (OHIP) which brings together different Hospitality cloud services as well as using technologies such as Integration Cloud to make it easy to interface 3rd party solutions.

Article / LinkAuthorSubject MatterConnecting
OIC and Oracle Hospitality (OHIP) – Getting the most out of Opera APIsNiall CommiskeyOICOracle Hospitality
OIC –> Netsuite & HubSpot – User Events calling OIC to sync Price changesNiall CommiskeyOICNetSuite, HubSpot
OIC –> HubSpot to Netsuite – Product SyncNiall CommiskeyOICNetSuite, HubSpot
Accessing Object Storage from Oracle Integration   
    
How to define a Repeating Global VariableJorge HerreriaOIC 
Connecting HubSpot with Netsuite Part 1 & Part 2Niall CommiskeyOICNetSuite, HubSpot
Connecting to NetSuite using Token Based AuthenticationSubhani Sahib ItalapuramOICNetSuite
OIC & OCI NotificationsNiall CommiskeyOICNetSuite, HubSpot
Using Aggregate Functions Sum(), Count() while Processing Larger FilesPhaneendra BommisettyOIC 
OIC Scheduling REST APIsSumeet SinghOIC 
Defining OIC SchedulesSumeet SinghOIC 
Introduction to Trading Partner ManagementArvind Venugopal and Sunil ApteOIC 
B2B Tracking for Wire and Business Transactions in Oracle IntegrationArvind Venugopal and Sunil ApteOIC 
DocuSign Adaptor in Oracle Integration Cloud – Configuring & Automating WorkflowBhumika GogiaProcessDocusign
DocuSign Adaptor in Oracle Integration Cloud – Setup & IntegrationBhumika GogiaOICDocusign
Throw New Fault Action TestingKabir Yadav (alias Amit Suman)OIC 
Create Calculator SOAP connectionKabir Yadav (alias Amit Suman)OIC 
Somewhat “Hidden” Feature: Reusable SubprocessJan KettenisOIC 
OIC Process Correlation: Take Good Care of Your PropertiesJan KettenisOIC 

Beating OIC’s FTP File Limits

OIC has for some time now provided an FTP adaptor and more recently included a full FTP server capability. But both have limits on the file size and capacity. The file constraints (1GB for a file and 500GB for the FTP server) shouldn’t be an issue for day to day activities. But OIC is often used to support SaaS Financials and other cloud solutions which do have monthly process cycles which can generate significant data volumes, for example, payroll data. The question is how to handle such data with such constraints?

Data Integration?

There is a school of thought that points to the possibility when handling such large data volumes we should consider using Data Integration rather than a more event-centric integration tool. Personally, I think there is a lot of validity in the argument, and anyone dealing with such bulky data activities should review and question if it is a better answer.

That said, there are cases where it does stand-up. For example:

  • If an organization is transitioning to a more event-driven or at least micro-batch model, you have to start the transition somewhere, but trying to line up changes everywhere can be problematic, so we have to start somewhere. Building an integration process so you have an event model developed, but in the interim, you need to take that bulk mechanism and convert it to a small stream of events.
  • You may be working with a bulk data extract and only need a small subset of the data provided, it won’t help if the data is also represented using a verbose notation such as XML.

Other Approaches

How to overcome the constraint? Oracle databases aren’t so constrained, and SQLLoader can provide an easy means to ingest the data into a staging table. The benefit of this is:

  • if you’re only needing a subset of the data you can pull just those columns from the table.
  • the bulk of the use of XML to be self-describing can be shed through using the DB schema as being more prescriptive.
  • SQL scripts can handle the checksum records removing that data and overhead from the integration process, leaving you to concentrate more on the business process.

If the data is still substantial once in the database there are a number of strategies to consume the data in more manageable chunks, such as

  • Running SQL script on the database that takes each row and calls the OIC as a restful API point. This approach is potentially very interesting as it may then mean if you’re moving towards an event process in the future the API endpoint represents the future state and the database stored procedure is mimicking the future client behaviour.
  • Use polling strategies and result set limits to control how much data is processed in a single execution of the integration. This approach does mean the integration needs to tag which records have been processed to avoid re-reading them.

Useful Links

Jan 21 – new OIC articles

Article / LinkAuthorSubject MatterConnecting
Invoke BI Report in OICKabir YadavOICBI
Read BI Report base64 encoded responseKabir YadavOICBI
OIC: The Micro Process Feature Making Life EasierJan KettenisOIC
API Gateway Integration: Quick and EasyVarinder KaurOICAPI
Automatic reactivation of Integration after a connection updateShubham AgrawalOIC
Replace Trigger in OrchestrationVijay KendaiOIC
Unlock new patterns of integration by controlling the HTTP Response status in OIC REST based integrationsAnuj KaushalOIC
February 2021 Oracle Integration UpdateAntony ReynoldsOIC
The OCI Designer Toolkit Documentation Generation (Not tested but assumed to also work with OIC)Andrew HopkinsonOCI
OIC February 21 New Features – B2B Trading Partner ManagementNiall CommiskeyOICB2B
OIC –> Process ArchivingNiall CommiskeyOICObject Storage
OIC –> JSON ObfuscationChris PeytierOIC
Simple Fusion ERP – OIC DemoNiall CommiskeyOICFusion Apps (ERP)
OIC – Tagging Instances for Feb 21 upgradeNiall CommiskeyOIC
OIC and Oracle Hospitality (OHIP)Niall CommiskeyOICOracle Hospitality
Protecting your OIC apis with OCI API GatewayNiall CommiskeyOICOCI API
Consolidate tasks from Oracle applications cloud and other applications into a single list of tasksMani KrishnanOICSaaS
Integration Insight in Oracle IntegrationThanos Terentes PrintziosOICInsights

Nov 20 – new OIC Articles

This month’s articles …

Article / LinkAuthorSubject MatterConnecting
Netsuite to Object StorageNiall CommiskeyOICNetsuite; Object Storage
DB Adapter –> Master/Detail InsertNiall CommiskeyOICDatabase
Complex SQL processingNiall CommiskeyOICDatabase
Netsuite adapter New FeaturesNiall CommiskeyOICNetsuite
new Monitoring/Mgt featuresNiall CommiskeyOIC
Data RetentionNiall CommiskeyOIC
Oracle Field Service via RESTNiall CommiskeyOICOracle Field Service
Generic Invoke for Scheduled JobsNiall CommiskeyOICSchedukler
How to configure Integration Properties in OICAmit Kumar SumanOIC
Oracle Integration Announcements On Home PageKundan VyasOIC
Recover unsaved changes for an Integration edit sessionVijay KendaiOIC
Oracle Integration November 2020 Update for Technical AdaptersPrakash MasandOICVarious
Track scheduled instances from submissionArya SanyalOIC
How to Invoke an OCI Function from the Oracle Integration CloudDaniel Martins TeixeiraOICFn
Oracle Integration: ICS to OIC Migration using an ATP DatabaseMichael MeinerOIC
Navigate between pages in Oracle Visual BuilderAnkur JainVBCS
OIC Health Check by OCI Monitoring and AlarmJin ParkOIC
OIC Log Management with VB Studio, OCI Bucket and OCI Logging AnalyticsJin ParkOIC

October 20 – New OIC articles

Article / LinkAuthorSubject MatterConnecting
OIC REST API for LookupsNiall CommiskeyOIC
OIC 4 Netsuite – Polling for New / Updated CustomersNiall CommiskeyOICBetsuite
Oracle Integration – Adapter Enhancements to Non Oracle ApplicationsArvind VenugopalOICNon Oracle
Security Improvements for Database & FTP AdaptersMichael MeinerOICDB & FTP
November 2020 UpdateAntony ReynoldsOIC
Oracle Integration November 2020 update for Oracle Applications AdaptersPrakash MasandOICOracle Apps
How to use the OCI Object Storage from the Oracle Integration CloudDaniel Martins TeixeiraOICOCI Object Store
Choosing Your Update WindowAntony ReynoldsOIC
Announcing The Visual Builder CookbookShay ShmeltzerVBCS
Connecting to API Gateway from Visual Builder with AuthenticationAparna GaonkarVBCS
Global Variable and Data Stitch in OICAmit Kumar SumanOIC
Configure OTM connection in OICAmit Kumar SumanOICOTM
Send attachment in OIC notificationAmit Kumar SumanOICEmail

Page 4 of 5

Powered by WordPress & Theme by Anders Norén