Research Institute for Key Indicators LLC (RIKI), directed by Dr Richard Fiene, Research Psychologist and Retired Professor of Psychology and Human Development, Penn State University, focus is to improve the quality of early care and education programs nationally and internationally through an empirically based Key Indicator methodology. Readers will find selected publications on the links listed below that describe the specific Key Indicator methodology created by Dr Fiene.

The Key Indicator methodology created by Dr Fiene in the 1970's which resulted in an Early Childhood Program Quality Improvement & Indicator Model (ECPQI2M4) has gone through four generations from 1975 through to 2013. The ECPQI2M4's key components/elements in improving child care quality are through an early childhood program quality indicator model of training, technical assistance, quality rating & improvement systems, professional development, mentoring, licensing, risk assessment, differential program monitoring, and accreditation. Please see the websites and publications which follow this brief overview, they contain many examples of the various key elements of ECPQI2M4. Also, please take a look at the following collection (RJFKEYS.pdf) of national examples of ECPQI2M4 which have Caring for Our Children BASICS (probably the most important ECE publication since Developmentally Appropriate Practice), Head Start Key Indicators, Stepping Stones, NACCRRA/Child Care Aware Report Cards, and National Early Childhood Program Accreditation (NECPA). These national examples are the logical extensions and end points in the development and implementation of the Early Childhood Program Quality Improvement & Indicator Model. The other powerpoint document (PPT135 NARA-RIKI.pdf) gives an overview to licensing measurement, regulatory compliance, program monitoring, ECPQI2M4, and DMLMA.

The latest model, Differential Monitoring Logic Model and Algorithm (DMLMA), is available for viewing in the publications and the links listed below. There you will find the Abstract and Presentation describing the DMLMA(c) in greater detail. Other selected publications are included to give the reader background materials/information regarding the evolution of the ECPQI2M(1-4).





RIKI - Research Institute for Key Indicators LLC, is a Pennsylvania Limited Liability Company (PA. Entity #: 4193691; DUNS #: 011323030). RIKI presently holds the copyright to the Early Childhood Program Quality Improvement and Indicator Model (ECPQI2M4(c)) and all its key elements and methodologies.


In 2015, RIKI and NARA (National Association for Regulatory Administration) entered into an exclusive partnership on the future development and implementation of differential monitoring, risk assessment and key indicators. As of October, 2015, the intellectual property rights to the Key Indicator Licensing System Methodology will be transferring to the National Association for Regulatory Administration (NARA) from the Research Institute for Key Indicators LLC (RIKI). Please see the following NARA Key Indicator Systems Brochures for additional details about the differential monitoring, risk assessment and key indicator methodologies:



Please see the Press Release on the NARA and RIKI Partnership (https://drfiene.files.wordpress.com/2013/03/nara-press-release-on-nara-riki-partnership.pdf).
Please contact NARA directly about the Key Indicator Licensing System Methodology at the following website: (http://www.naralicensing.org/)*
NARA Key Indicator WebinarNARA Risk Assessment Webinar (Stepping Stones)http://www.naralicensing.org/training-consultinghttp://www.naralicensing.org/strategic-partnershipsNARA Key Indicator Webpage


Dr Fiene can be contacted at the following email addresses or Web Pages:


Email: RIKI.Institute@gmail.com or RFiene@NARALicensing.org or rjf8@psu.edu or Fiene@RIKInstitute.com

Web Pages:
LinkedIn* (https://www.linkedin.com/in/rikirichardfiene)*
Alignable (https://www.alignable.com/hummelstown-pa/riki-research-institute-for-key-indicators)
ResearchGate (https://www.researchgate.net/profile/Richard_Fiene)
NIH My Bibliography (https://www.ncbi.nlm.nih.gov/sites/myncbi/1ZqSb7-Y9pvQk/bibliography/53500370/public/?sort=date&direction=ascending)
Edna Bennett Pierce Prevention Research Center at Penn State (http://prevention.psu.edu/people/fiene-richard)
Human Development & Family Studies Department at Penn State (http://www.hhdev.psu.edu/hdfs/faculty-staff/courtesy)
NIH iLookOut Child Abuse Prevention Program, Center for the Protection of Children, Penn State College of Medicine (https://clinicaltrials.gov/ct2/show/NCT02225301)
iLookOut Child Abuse Prevention Program (https://ilookoutproject.org/)
The Pennsylvania State University (http://www.psu.edu/search/gss?query=richard%20fiene)
RIKI Selected Publications (http://padlet.com/riki_institute/RIKI) (http://padlet.com/RIKILLC/Research_Institute_for_Key_Indicators_LLC) (http://padlet.com/rikirjf/RIKILLC)
Google+ RJF* (https://plus.google.com/u/1/+DrRichardFiene)
Google+ RIKI* (https://plus.google.com/104371037538443414170/about)
Twitter* (https://twitter.com/rikillc)
Facebook RIKI* (https://www.facebook.com/pages/RIKI/1561240064118672?sk=info&tab=page_info)
Tumbler (http://rikillc.tumblr.com/)
Pinterest ((https://www.pinterest.com/researchins0345/)
RIKI Blog* (http://RIKInstitute.blogspot.com) (http://RIKInstitute0.blogspot.com)

Also, please see these web sites for additional information regarding DMLMA/ECPQIM research:
CCEERC (http://www.researchconnections.org/childcare/resources?q=richard+fiene) (150)
Google Scholar (http://scholar.google.com/scholar?hl=en&q=%22richard+fiene%22&btnG=&as_sdt=1%2C39&as_sdtp=) (135)
Google Books (https://www.google.com/search?tbm=bks&q=%22richard+Fiene%22) (50+)
NARA* (http://www.naralicensing.org/publications-archive) (50)*
Academic.edu*+* (http://pennstate.academia.edu/RickFiene) (25)*
HathiTrust Digital Library (http://babel.hathitrust.org/cgi/ls?field1=ocr;q1=%22Richard%20Fiene%22;a=srchls) (100+)
WorldCAT (https://www.worldcat.org/search?q=%22RICHARD+FIENE%22&fq=&dblist=638&start=41&qt=next_page) (50+)
Penn State Libraries CAT (http://psu.summon.serialssolutions.com/#!/search?ho=t&l=en&q=%22richard%20fiene%22) (150+)
CAECTI/PSH (https://psu.app.box.com/s/sh1s2e3ibg8139smqc8dkp5su9nmo39e?sortColumn=date&sortDirection=desc&pageSize=20&pageNumber=0) (75+)
PRC/PSU (http://www.prevention.psu.edu/early-childhood-publications-and-ucpc) (75+)
RIKI (http://RIKInstitute.com)(100+)
Research Institute for Key Indicators LLC (http://rikinstitute.wikispaces.com)(200+)


Additional publications, presentations, policies, programs, and legislation are available on the following web sites:
VIDEO AND AUDIO:
Differential Monitoring, Risk Assessment, Key Indicators (https://www.youtube.com/watch?v=lR5qRryeCg4&feature=youtu.be)
OCC: The Benefits of Monitoring 2015 (https://www.youtube.com/watch?v=sKHfrBwssyQ&feature=em-share_video_user)d
STAM/OCC/ACF Plenary Session on Monitoring 2014 (http://www.acf.hhs.gov/programs/occ/resource/stam-2013-monitoring-plenary-highlights-part-i)
STAM 2015 Raising the Bar on Quality (https://childcareta.acf.hhs.gov/resource/july-stam-meeting#Raising-Quality-Bar)
NARA Key Indicator PPT and Audio (https://zoom.us/recording/play/4L2v_U3rxDuNe5bZDPpR8mEXaIpkXzunaG_H8k0hWULjUVJ6CiqTeo0NmMVpHQyw)


FEDERAL:
Federal Register/CCDF NPRM (https://www.federalregister.gov/articles/2013/05/20/2013-11673/child-care-and-development-fund-ccdf-program#h-48)
Federal Register/CCDBF NPRM (https://www.federalregister.gov/articles/2015/12/24/2015-31883/child-care-and-development-fund-program)
CCDBG Reauthorization (http://www.acf.hhs.gov/programs/occ/ccdf-reauthorization)
CCDBG Bill 2014 (https://www.govtrack.us/congress/bills/113/s1086/text)
Caring for Our Children Basics (CFOC-B) (https://www.federalregister.gov/articles/2014/12/18/2014-29649/caring-for-our-children-basics-comment-request)
Caring for Our Children Basics Webinar (https://www.acf.hhs.gov/programs/occ/resource/caring-for-our-children-basics-webinar)
Caring for Our Children Basics Final (http://www.acf.hhs.gov/programs/ecd/caring-for-our-children-basics)
CCDF Reauthorization (https://childcareta.acf.hhs.gov/ccdf-reauthorization)
CCDF 2015 Webinar Protecting Health & Safety of Children in Child Care (http://rikinstitute.wikispaces.com/file/view/2015_nprm_hs_slides.pdf/573629981/2015_nprm_hs_slides.pdf)
CCDF 2015 Webinar Video Protecting Health & Safety of Children in Child Care (https://www.youtube.com/watch?v=tcm8jPiFQq8)
CCDF Health and Safety Requirements Fact Sheet (https://childcareta.acf.hhs.gov/sites/default/files/public/286_1508_healthsafety_summary_training_final_0.pdf)
Head Start Key Indicators (HSKI) OHS (http://eclkc.ohs.acf.hhs.gov/hslc/grants/monitoring)(http://eclkc.ohs.acf.hhs.gov/hslc/grants/monitoring/HeadStartKeyIn.htm)
Revision of the Head Start Performance Standards Webinar (http://eclkc.ohs.acf.hhs.gov/hslc/standards/hspps/nprm/docs/ohs-nprm-webinar.pdf)
ACF ECD 2015 Accomplishments (https://www.acf.hhs.gov/sites/default/files/ecd/clean_ecd_accomplishments_2015.pdf)
HHS/USDA Joint Monitoring Statement (http://www.acf.hhs.gov/ecd/joint-monitoring)

ASSISTANT SECRETARY'S OFFICE FOR PLANNING AND EVALUATION:
ASPE/Monitoring White Paper on Monitoring (http://aspe.hhs.gov/hsp/15/ece_monitoring/rpt_ece_monitoring.cfm)
ASPE/HHS Parent's Guide and ASPE/HHS Research Monograph (http://aspe.hhs.gov/basic-report/13-indicators-quality-child-care)
ASPE/LITES Compelling Models (https://aspe.hhs.gov/pdf-report/learning-about-infant-and-toddler-early-education-services-lites-summarizing-research-and-gaps-compelling-models)
ASPE/LITES (https://aspe.hhs.gov/learning-about-infant-and-toddler-early-education-services-lites)

NATIONAL AND INTERNATIONAL ORGANIZATIONS:
National Program Standards Crosswalk Tool (https://qrisguide.acf.hhs.gov/crosswalk/index.cfm?event=page.aboutStandards)
NARA Key Indicators (http://www.naralicensing.org/key-indicators)
APHA Presentation on National Health & Safety Checklist (https://apha.confex.com/apha/141am/webprogram/Paper275254.html)
NRCKids Parent's Guide 2015 (http://nrckids.org/index.cfm/parentsguardians/how-to-choose-high-quality-childcare/)
NRC/SS3 Standards (http://nrckids.org/index.cfm/products/stepping-stones-to-caring-for-our-children-3rd-edition-ss3/)
NRC/CFOC3 National ECE Health and Safety Standards (http://cfoc.nrckids.org/)
NECPA Accreditation (http://www.necpa.net/qualityandresearch.php)
PITC - Program for Infant Toddler Caregiving - The Center for Child & Family Studies (http://clas.uiuc.edu/fulltext/cl03267/cl03267.html)
CLIA Cruise Lines International Association Standards (https://drfiene.files.wordpress.com/2013/03/2013-clia.pdf)
Chilean Study (http://rikinstitute.wikispaces.com/file/view/Chile%20PQ%20Study.pdf/573883783/Chile%20PQ%20Study.pdf)
UNICEF CDPES - Child Development Program Evaluation Scale Summary (http://www.unicef.org/ceecis/Tool_16.pdf)
NIEER/QRIS & Pre-K (http://nieer.org/publications/it%E2%80%99s-stars-more-states-are-using-quality-rating-systems-pre-k)
BUILD QRIS (http://qrisnetwork.org/member/calendar/event/140226/validating-licensing-compliance-and-quality-early-childhood-state-syste)
Child Policy University Consortium/SRCD (http://childpolicyuniversityconsortium.com/pdfs/Update_Policy_Relevant_Materials.pdf)
CLASP (http://www.clasp.org/issues/child-care-and-early-education/pages/body/Chapter2_CCDBGGuide.pdf)
NARA Strong Licensing (http://www.naralicensing.drivehq.com/publications/Strong_cc_Licensing_2011.pdf)
National Head Start Association (NHSA) (https://www.nhsa.org/files/resources/mtf_report.pdf)

EARLY CHILDHOOD RESEARCH:
ECRQ Special Issue on QRIS Research (http://www.mathematica-mpr.com/news/early-childhood-research-quarterly)
ECRQ Journal Article on Validation (http://www.sciencedirect.com/science/article/pii/S0885200614000337)
Early Childhood NEWS (http://www.earlychildhoodnews.com/earlychildhood/article_view.aspx?ArticleID=584)
New America EdCentral (http://www.edcentral.org/monitoring/)
Dowdy Thesis (http://www.csus.edu/ppa/thesis-project/bank/2011/Dowdy.pdf)
Bohleber Dissertation (http://scholarworks.waldenu.edu/cgi/viewcontent.cgi?article=2980&context=dissertations)
Egert Dissertation (http://rikinstitute.wikispaces.com/file/view/EGERTFranziskaDisssek_A3a.pdf/573883123/EGERTFranziskaDisssek_A3a.pdf)
Qi Ph.D. Thesis (http://bbktheses.da.ulcc.ac.uk/152/1/cp_Fullversion-2015QiXphdBBK.pdf)
Penn State Prevention Research Center Seminar (http://www.prevention.psu.edu/media/prc/files/FieneTalk.pdf)

STATES:
Georgia DECAL Validation Study Report (http://decal.ga.gov/BftS/ChildCareServicesStudy.aspx)
Georgia DECAL Validation Study Presentation (http://decal.ga.gov/documents/attachments/ChildCareLicensingStudy_Presentation.pdf)
Georgia DECAL Enforcement and Compliance Policy (http://decal.ga.gov/CCS/EnforcementCompliancePolicy.aspx)
California Key Indicator Proposed Legislation (http://asmdc.org/members/a57/news-room/press-releases/assemblymember-ian-calderons-legislation-calling-for-annual-unannounced-regulatory-visits-to-community-care-facilities-passes-assembly-human-services)
California/MyCCL New Directions Key Indicator Project with Fact Sheets and Pilot Test (http://www.myccl.ca.gov/default.asp?b=New_Directions)
Washington State DEL Licensing and Differential Monitoring (please see section #10 below for examples)
Maine (http://legislature.maine.gov/uploads/originals/dlrs-status-update-7-1-15.pdf)
Massachusetts (http://www.naralicensing.org/assets/docs/Seminar2015/g-3%20nara%20conference%20presentation_diff%20licensing%20in%20ma_final.pdf)

NACCRRA/CHILD CARE AWARE:
NACCRRA Parent's Guide (http://www.naccrra.org/sites/default/files/publications/naccrra_publications/2012/isthistherightplaceformychild.pdf)
NACCRRA/NARA (http://www.naralicensing.org/assets/docs/Presentations/1naccrra.pdf)

OFFICE OF CHILD CARE:
Differential Monitoring, Risk Assessment and Key Indicators (https://childcareta.acf.hhs.gov/sites/default/files/public/1408_differential_monitoring_final_1.pdf)
Efficient and Effective Monitoring in Licensing Peer Learning Group (https://childcareta.acf.hhs.gov/resource/resources-2017-efficient-and-effective-monitoring-licensing-peer-learning-group)


DMLMA/ECPQIM Presentations, Posters, Articles, Papers, Tools, Data, Technical Notes, and Research Reports (#3/4/12)
1) Introduction to the Early Childhood Program Quality Improvement & Indicator Model (ECPQIM)(#1)2) State Validation, Key Indicator, Blueprint Reports (#2)3) Background Research to the Development of ECPQIM/DMLMA (#1/2)4) State Validation Report Examples (#4)5) Federal (ACF, OCC) & CFOCBASICS6) State Validation Model, QRIS Evaluation, Quality Study (#4)7) National Health and Safety Checklist and ECELS CFOC8) Head Start (HSKI - Head Start Key Indicator Tool)9) National Association for Regulatory Administration (NARA)10) Policies and Examples for Key Indicators and Risk Assessment11) Opinion Papers, Notes, Technical Updates (#3/7)12) RIKI Reports Summary & Licensing Quality Assurance Research Blueprint13) ACF Accomplishments, CFOCB, CCDF Plan, CCDBG Regs, OIG CCDF Report, OPRE Coordinated Monitoring (#8)14) Differential Monitoring Logic Model Scoring Protocol (#1/2)15) State Key Indicators and Risk Assessment Forms, Matrix and Differential Monitoring Approaches (#3)16) ASPE Innovations in Program Monitoring White Paper Summary and Report (#8)17) National Resource Center for Health and Safety in Child Care and Early Education18) Professional Development, Training, Mentoring, Child Outcomes, and Accreditation19) Tools/Data - Health and Safety National Tool, Child Development Program Evaluation Scale/COFAS20) ECPQIM - Early Childhood Program Quality Improvement & Indicator Model National Data Base (#7)21) Posters - National Child Care Benchmarks, Professional Development, Child Outcomes, ACR Model22) Vita, Bio, and Publication Summaries23) Powerpoints, Videos, Webinars - Early Childhood Program Quality Improvement/Indicator Model and DMLMA24) National Collaborative Proposals (ACF, NIH) HMC/PSU & UCSF25) Validation Studies (#4)26) Selected Proposals


1) INTRODUCTION (DM):




2) STATE VALIDATION, KEY INDICATOR, BLUEPRINT REPORTS (KI, RA):










3) BACKGROUND (DM):












4) STATE VALIDATION REPORTS (KI, CI/PC, RA, PQ):




5) FEDERAL (HHS, USDA, ACF, OCC) & (CFOCBASICS)(DM, RA, KI):








6) STATE VALIDATION MODEL, QRIS EVALUATION, QUALITY INITIATIVES, QUALITY STUDY (PQ):


























7) NATIONAL HEALTH AND SAFETY CHECKLIST AND ECELS CFOC (PD, RA, KI):














8) HEAD START (HSKI - HEAD START KEY INDICATOR TOOL)(KI, DM):














9) NATIONAL ASSOCIATION FOR REGULATORY ADMINISTRATION (NARA)(DM, KI, RA, QI):












10) POLICIES AND EXAMPLES FOR KEY INDICATORS AND RISK ASSESSMENT (KI, RA):












11) OPINION PAPERS, NOTES, TECHNICAL UPDATES (DM, KI, RA, CO, PD, PQ, PC):




















12) RIKI REPORTS SUMMARY & LICENSING/QUALITY ASSURANCE RESEARCH BLUEPRINT (DM, RA, KI):




13) HHS, USDA, ACF, CFOCB, HSKI-C DIFFERENTIAL MONITORING, CCDF PLAN, CCDBG REGS, OIG CCDF REPORT, OPRE (DM, RA, KI):










14) DMLM SCORING PROTOCOL (DM):




15) STATE KEY INDICATORS AND RISK ASSESSMENT FORMS, MATRIX AND DIFFERENTIAL MONITORING APPROACHES (DM, RA, KI):






16) ASPE WHITE PAPER SUMMARY AND REPORT (PM, DM):




17) NATIONAL RESOURCE CENTER FOR HEALTH AND SAFETY IN CHILD CARE AND EARLY EDUCATION (KI)(RA)(CI) and NATIONAL CENTER FOR EARLY CHILDHOOD QUALITY ASSURANCE:








18) PROFESSIONAL DEVELOPMENT, TRAINING, MENTORING, CHILD OUTCOMES, AND ACCREDITATION (PD, CO, PQ):
























19) TOOLS AND DATA (PC, PQ, CO):
















20) ECQPIM - EARLY CHILDHOOD PROGRAM QUALITY IMPROVEMENT AND INDICATOR MODEL NATIONAL DATA BASE
























21) POSTERS (DM, KI, RA, PD, CO, PQ, PC):








22) VITA, BIO and PUBS (DM, PC/CI, PQ, KI, RA, CO, PD):






















23) POWERPOINTS, VIDEOS, AND WEBINARS (DM, PC/CI, PQ, KI, RA, CO, PD):

























24) NATIONAL COLLABORATIVE PROPOSALS, CONTRACTS, ENGAGEMENTS (PC/CI, PD, RA, KI):






25) VALIDATION STUDIES (PC/CI, RA, KI):




26) SELECTED PROPOSALS (PC, PQ (PD)):






LEGEND:
DM = DIFFERENTIAL MONITORING (CONCEPTUAL)
CI/PC = COMPREHENSIVE TOOL/PROGRAM COMPLIANCE
PQ = PROGRAM QUALITY
RA = RISK ASSESSMENT
KI = KEY INDICATORS
PD = PROFESSIONAL DEVELOPMENT
CO = CHILD OUTCOMES



Hopefully the above websites and reports/papers have provided you with an overview to the Early Childhood Program Quality Improvement and Indicator Model (ECPQI2M4). The evolution of the ECPQI2M4 has occurred over the past 40 years and has led us to begin to identify core indicators in the various major delivery systems. For example, in the licensing system dealing with basic health and safety we have been able to validate the use of key indicators with Caring for Our Children Basics//, in Quality Rating and Improvement Systems (QRIS) we have been able to validate family engagement indicators, in professional development we have identified mentoring/coaching as a key indicator in the types of effective delivery of services, and overall core indicators dealing with qualified directors and teachers. So the bottom line is for our public policy to invest our resources into the trilogy of directors, teachers, and parents.


Richard Fiene, Ph.D., Research Psychologist
RIKI - Research Institute for Key Indicators LLC and
Senior Consultant for Licensing Measurement & Systems
NARA - National Association for Regulatory Administration
Affiliate Professor, Penn State Prevention Research Center
Retired Professor of Psychology and Human Development