iCare.com

REAL WORLD TESTING RESULTS 2025

GENERAL INFORMATION

Plan Report ID Number: [For ONC-Authorized Certification Body use only] 

Developer Name:  iCare.com LLC

Product Name(s):  iCare EHR

Version Number(s):  V 2.0

Certified Health IT Product List (CHPL) ID(s): 15.04.04.2617.iCar.02.00.1.200220 

Developer Real World Testing Page URL:  https://icare.com/realworldtesting

 

SUMMARY OF TESTING METHODS AND KEY FINDINGS

The iCare.com EHR is a cloud based EHR, therefore our Real World Testing plan included considerations for our delivery methodology which differs significantly from on-premise software.  The iCare cloud environment permitted us to monitor and test the criteria of our certified technology without the requirement to involve our customers with significant portions of the testing methodologies.

The annual Real World Testing for 2025 was performed by iCare.com using metrics from our production environment which serves actual customers using our software to manage the healthcare of real patients.

During Real World Testing activities, we anticipated that there could be instances where we may find a need to modify our testing methodologies, approaches, or expected outcomes that were originally laid out in our plans to address unexpected changes during the testing period.  In such instances, we would adjust our Real World Testing approaches and our results report will include a description of these types of changes, the reasons for them, and how intended outcomes were more efficiently met as a result.  No modifications to the original testing plan were required however the measures tested were limited based on directions from ASTP/ONC.

Please note that the Real World Testing Plan referenced in the CMS CHPL may not reflect the currently implemented plan.

The following list is a summary of the Real World Testing Approach.

  1. The live production and test environments were used for Real World Testing.
  2. Customers used the iCare system as usual and customer involvement was limited to those areas where it was necessary.
  3. Data was recorded quarterly.
  4. The Data Export functionality was tested periodically as required.
  5. When sufficient live data was not available, synthetic data was generated and tested in a shadow (test instance) environment.

WORLD TESTING PLAN TEMPLATE 

 

 

Care Setting(s)

Our Real World Testing was conducted within clinical settings in which our certified health IT is marketed. While health IT developers are not required to test their certified health IT in every setting in which it is marketed for use, we tested in various settings. 

The following care settings were included in testing.

  1. Hospital
  2. Ambulatory & Emergency Care
  3. Physician Practice

 

Relied Upon Software

The following third party software was relied upon to perform portions of the Real World Testing for several measures:

EMR Direct Interoperability Engine

Metrics and Outcomes

We have detailed outcomes from our testing that successfully demonstrate that our certified health IT:

  1. is compliant with the certification criteria, including the required technical standards and vocabulary code sets;
  2. is enabled to exchange electronic health information (EHI) in the care and practice settings for which it is marketed for use; and/or,
  3. EHI is received by and used in the certified health IT.

This section describes how the specific data collected from their Real World Testing measures demonstrate our results.

Criterion

Measurement

/Metric

Actual Results (2025 Real-World)

Supplemental Interactive Testing Outcome

Notes

170.315(g)(7)

Patient search requests & success

0 requests

Successfully demonstrated patient matching and ID issuance using synthetic data in mirrored environment

Pass;
no non-conformities

170.315(g)(9)

All-data retrieval requests & success

0 requests

Successfully returned complete USCDI bundles

Pass;
conformance verified

170.315(g)(10)

Single-patient & Bulk FHIR queries

0 calls / 0 Bulk exports

Successfully executed standardized operations (authentication, searches, exports) with no errors or deviations

Pass;
no non-conformities

 

 

Summary of Findings

Due to our early-stage product lifecycle and absence of live deployments with third-party integrations, no production API utilization for these criteria was observed in 2025. Audit logs confirm zero attempts/errors. To affirm ongoing conformance, interactive testing was conducted in a production-mirror environment using synthetic data; all tested operations met certification requirements (FHIR R4/US Core/USCDI) with successful outcomes and no identified issues. This supports the module’s readiness for real-world use as adoption grows.

Key Milestones

The following is a list of key milestones that were met during the Real World Testing process.  Details are included on how and when we implemented measures and collected data.

Key Milestone

Care Setting

Date/Timeframe

During the 3rd Quarter of 2025, the testing for all required measures started as outlined in the plan. The production environment users kept their routine data entry practices in place for actual patients.

Ambulatory and Hospital

January 1, 2025 –
December 31, 2025

We started final report generation during the first week of Jan 2026 and performed evaluation and analysis as applicable for the 4th quarter.

Ambulatory and Hospital

January 2026

Upload of final report

Ambulatory and Hospital

First week of February 2026

Powered by iCare