SPRING 2017 Provider Training - Florida Department Of Education
SPRING 2017 Provider TrainingQuality Assurance and Compliance Monitoringwww.FLDOE.org1
Spring 2017 Provider Training WebinarDecember 15, 201610:00 AM – 12:00 PM (EST)Webinar registration link:www.gotomeeting.com/webinar/homepageCall number: 1-888-670-3525Participant Access Code: 4632608161 thenpress #www.FLDOE.org2
Please minimize background noise during thewebinar. Please keep your phone on mute to listen to thewebinar. This eliminates background noise anddiscussions from disrupting the webinar. If your phone does not have a mute button, press*6 Press *6 to unmute.www.FLDOE.org3
FACILITATORTashi Williams, Compliance DirectorQuality Assurance and Compliance SectionDivision of Career and Adult Education850-245-9033www.FLDOE.org4
Objectives of Conference CallTo provide participants with information regarding grantprogram monitoring scheduled for Fiscal Year 2016-17www.FLDOE.org5
Fiscal Years and Programs Monitored Fiscal Years (FY) monitored:o 2014-15, 2015-16 and 2016-17 Grant Programs to be monitored:o Adult Education (AE)o Carl D. Perkins (CTE)www.FLDOE.org6
Topics to be Covered on the Call Why do we monitor and what is our way of work?Enhancements to the Risk AssessmentHow do we select agencies to monitor?Agencies selected for spring 2017 monitoringMonitoring strategies and areas of focusPre-visit, on-site/desk review, and post-visit activitiesItems to have available for the monitoring reviewProgram of Study RequirementPost-visit monitoring reportExamples of findings and concerns found during themonitoring review Team introduction General Q & Awww.FLDOE.org7
Quality Assurance and Compliance TeamDr. Shahrokh MassoudiLaStacia SpencerJudieth TaylorMichael Swiftwww.FLDOE.org8
Why do We Monitor? Federal and state requirementAccountability – program and fiscalOpportunity for needed correctionsContinuous improvement and positive changesRecognitionwww.FLDOE.org9
What is Our Way of Work?Implementation of a risk-based system that is: Based on project riskCollaborative in nature;Recognizes positive practices;Identifies findings and concerns related toprogram quality and compliance; and, Supports systemic and continuous program improvementwww.FLDOE.org10
Risk Assessment Factors 2016-17Risk Matrix – Operational Risk Factors (Metrics) Number of grants Total amount of agency funding Number of grant funds remaining Perkins Program Improvement Plan (PIP)* Audit/monitoring findings Change in director* Denotes new data element as of 2014-2015www.FLDOE.org11
2016-17 Quality Assurance Enhancements Perkins PIP Index Risk score divided into quartiles Balanced weight between dataelementsUpper Quartile/Higher 7Upper Middle5Lower Middle3Lower Quartile1Zero0www.FLDOE.org12
2016-17 Risk Assessment ProcessCalculation of the Risk Score: Point Value Assigned X Weight Total Metric Point Sum of all Metric Points Agency Risk Scorewww.FLDOE.org13
(Sample) Risk Matrix for Colleges, Districts, Non-College/Non-District Receiving Carl D. Perkins GrantsAgency Name: Sunshine State CollegeTarget Year: 2014-2015 (Monitoring Year 2016-2017)MetricTotal Budget for all Perkins GrantsCombinedNumber of Perkins Grants*3-year Perkins Improvement Plan(PIP) IndexAgency CTE Program DirectorChange from Previous Fiscal YearUnexpended Funds from allPerkins Grants Combined# OAG Audit FindingsScalingPoint ValueUpper QuartileUpper MiddleLower MiddleLower Quartile4 3217.50 – 10.005.00 – 7.492.50 – 4.990 index 2.500Yes75317531753107No0Upper QuartileUpper MiddleLower MiddleLower Quartile0Upper QuartileUpper MiddleLower MiddleLower Quartile75310753100Point Value Assigned(PVA)WeightTotal Metric Points(PVA X Weight)5X 10507X8560X807X6421X443X412AGENCY RISK SCORE:www.FLDOE.org16414
Risk Assessment Process 2014-15 grant data was used for risk calculations Monitoring will address grants from 2014-15 through 201617 Additional programs in the geographical area may also bereviewed/monitoredwww.FLDOE.org15
IMPORTANT! A high risk assessment score should NEVER be interpretedas a negative reflection on the provider.www.FLDOE.org16
Provider Selection 2016-17 Agencies with the highest risk matrix may be targeted formonitoring Monitor both CTE and AE Various monitoring strategies are implementedwww.FLDOE.org17
Quality AssuranceSpring 2017 targeted providers for on-site or deskmonitoring: Miami-Dade College South Florida State College Hillsborough County School Florida Department ofDistrict Pinellas County School DistrictCorrections St. Petersburg College Palm Beach County SchoolDistrict Osceola County School Districtwww.FLDOE.org18
Monitoring Process Pre-visit, on-site/desk review and post-visit/desk reviewactivities Records and data reviews (all phases) Direct observation (on-site) Interviews (on-site and conference call)o Phone calls, emailso Referrals Resolution Plans:o Corrective Action Plans (Findings)o Action Plan (Concerns)www.FLDOE.org19
Pre-visit Activities Notification (personal and correspondence)Webinar training for providersTeam leader coordinationCoordination with Quality Assurance and ComplianceTeam Leader:o Confirmation of agency contact (preferably one designee peragency for AE and CTE programs)o Coordination and communication with DOE team leadero Develop site visit schedule (onsite)o Submit Program of Study Materials as requestedwww.FLDOE.org20
Information Required Organizational chart List of administrative staff with duties relevant to thesegrants; including location and contact numbers If available, a map of the district/county indicating locationsof program sites List of all AE and/or CTE program sites including:o Name, address, and zip codeo Principal/Dean/Director name and phone numbero Hours of operation Agency’s list of documents (AE and CTE related) that arerequired to be contained in a student’s record Program of Study Materials as requestedwww.FLDOE.org21
Desk Monitoring Activities Desk monitoring review instrument is sent via email tothe provider designee:o and Fiscal Allowable Cost Protocol Provider returns completed desk monitoring reviewo Review of desk monitoring instrument Exit Conference by phone Draft report is emailed to the provider for feedbacko Resolution Plan if applicable Final Report is mailed to the provider Closure letter is sent to the providerwww.FLDOE.org22
On-site Activities Entrance Conference – 1 hour maximumo Provider presentations optionalo Discussion of monitoring Interviewso Administratorso Teachers/Instructorso Students (group)o Staff/Faculty Observations Records Review (2014-15, 2015-16 and E.org23
On-site Activities - continued Equipment Inventoryo According to EDGAR specifications – (2014-15 and 2016-17 grants)o According to the Uniform Grant Guidance (UGG) – (2015-16 grants)The final rule implementing the UGG was published in the FederalRegister on December 19, 2014, and becomes effective for new andcontinuation awards issued on or after December 26, 2014. Perkins Program Improvement Plans (if applicable) Program of Study Conference Call Exit conferencewww.FLDOE.org24
Have Available on the First Day (on-site) Access to records for:o FY 2014-15o FY 2015-16o FY 2016-17 Policy/handbook for employees PLEASE DO NOT MAKE COPIES! Handbooks and materials for students (include student enrollmentpacket) Attendance policies Recruitment efforts General policies and procedures Governing board and advisory committee(s) related documents(may be a procedures manual)www.FLDOE.org25
First Day - continued Recruitment activities and materials for agency’s programs Financial policies and procedures including those related to purchasingand procurement of contractual services, equipment and supplies Travel and purchasing records Local data procedures An inventory of equipment purchased with the grant funds, by site Maps to each AE and/or CTE class location Staff to alert to our visit:o Finance Directoro MIS Director/Institutional Researcho Staff involved with the Program of Studyo Other appropriate administrator(s), dean(s) or principal(s) P.S. We pay for our own food and drink!www.FLDOE.org26
Inventory GuidelinesThe following elements are required on the inventory of allequipment purchased.2 C.F.R. 200, Uniform Grant Guidance, 200.313 Equipment:Property records must be maintained that include: Description of Property Percentage of Federal Participation Serial Number/ID Number Location of Property The source of the funding Use and Condition of Property Title Holder Sale Price Acquisition Date Date of Disposal Cost of Propertywww.FLDOE.org27
Sample Property Inventory Listwww.FLDOE.org28
Sample Program Of Study Materials Copy of POS Form outlining pathway for students to movefrom secondary to postsecondary and into the workforcefrom the 2014-15 Request for Application (RFA) Copy of Local Articulation Agreements for this Program ofStudy Responses to Program of Study narrative section ofmonitoring protocol Other materials as requested to validate Program of Studywww.FLDOE.org29
Career Cluster: Health ScienceCTE Program: Nursing Assistant (8417210)Career Cluster Pathway: Therapeutic ServicesIndustry Certification: Certified Nursing Assistant (FDMQA002)16 CORE CURRICULUM CREDITSDistrict Logo CREDIT CAREERPOSTSECONDARYHIGH SCHOOL ENGLISHMATH4 credits4 creditsSCIENCE3 credits, 2with labSOCIALSTUDIES3 credits8 ADDITIONAL CREDITSOTHER REQUIREDCOURSESFINE ARTS (1 credit)PHYSICAL EDUCATION(1 credit)CAREER LIGNED WITH COMMUNITYCOLLEGE & STATE UNIVERSITYSYSTEM PROGRAMS)Students are encouraged to begin planning for careers and postsecondary options by exploring resources at mycareershines.org.Students are also encouraged to participate in dual enrollment courses which may be used to satisfy high school graduation or Bright Futures Gold SealVocational Scholars course requirements.Students planning to enroll in any postsecondary degree program should take the Postsecondary Education Readiness Test (PERT) in eleventh grade ifthey do not earn college-ready scores on the FCAT, FCAT 2.0, or subject area end-of-course exam.9thEnglish 1 or HAlg. 1 or H, orGeometry or HPhysical Scienceor Biology HNone or APHuman GeographyPhysical Education(1credit)Principles ofBiomedical ScienceHealth ScienceAnatomy &Physiology10thEnglish 2 or HGeometry or H, orAlg. 2 or HBiology H or AP,World History, H orAP11thEnglish 3, H, APLanguage,Alg. 2 or H, orAnalysis ofFunctionChemistry, H or APAmerican History,H or US History APPractical Arts or FineArts course (1 credit)Health ScienceFoundationsOther elective12thEnglish 4, H, or APLiteratureTrig/AnalyticalGeometry orCalculus, H or ABPhysics, H, AP orIB, or studentchoice of science,H or APEconomics, H orAP and AmericanGovernment, H orAPComputing for Collegeand CareersNursing Assistant 3Home Health AideForeign Language 1Foreign Language 2Based on the Career Cluster of interest and identified career and technical education program, the following postsecondary options are available.TECHNICAL CENTERPROGRAM(S)COMMUNITY COLLEGE PROGRAM(S)UNIVERSITY PROGRAM(S)[Tech Center][Community College][State University]Nursing AssistantPractical NursingNursing (AS)Practical Nursing (LPN)Nursing (AS, BSN)Health Science (BSN)Sample Career Specialties (The Targeted Occupations List may be used to identify appropriate careers)Certified Nursing AssistantLicensed Practical NurseRegistered NurseNursing ProfessionalRegistered NurseNurse EducatorArticulation and CTE Dual Enrollment Opportunitieswww.FLDOE.org30
CREDITArticulation and CTE Dual Enrollment OpportunitiesSecondary to Technical Center(PSAV)Secondary to College Credit Certificate or DegreePSAV/PSV to AAS or AS/BS/BAS(Minimum # of clock or credit hours awarded)(Statewide and other local agreements may be includedhere)(Minimum # of clock hours awarded)[Tech Center]Licensing Practical Nurse,Nursing Assistant – Basic HealthCare Worker (90 clock hours forHealth Science Foundations)[College(s)]3 credit hours of HSC2531 awarded from passing [College] MedicalTerminology Exemption Exam for the Registered Nurse ProgramAS to BSN Registered Nurse (120-128hours - Statewide)Career and Technical Student AssociationHOSAInternship/Work Experience Recommendations, Work, volunteer, intern, shadow at hospitals, clinics, nursing and rehabilitation facilities and school nurse or district or community clinics.Program of Study Graduation Requirements: entswww.FLDOE.org31
Post-visit Activities Thank you letters & evaluation survey Monitoring Reporto Draft – sent to director for feedbacko Final – sent to agency head Resolution activitieso Corrective Action Plan – for Findingso Action Plan – for Concernso Follow – up communication Closure letterwww.FLDOE.org32
Monitoring ReportAreas of Focus: AdministrationDataLearning EnvironmentsStudent PerspectiveCurriculum and InstructionFinancialRecords ReviewProgram of StudyTechnology and EquipmentCollaborationwww.FLDOE.org33
Common Findings Discovered in OnsiteMonitoring Visits to Agencies Lack of Advisory Committee in CTE programso Absence of statementso Lack of advisory committee implementation and involvemento Lack of business and industry relationships with programs andparental involvement Safety and Security findingsAuthority/Law: Life Safety Code 101 (includes schools andcolleges), Florida Fire Prevention Code, National FireProtection Association 1 (NFPA1) – Chapter 60 and 66o Exposed wires and extension cordso Safety rules not posted (e.g., auto, welding)o Lack of ramp for wheelchair accessibilitywww.FLDOE.org34
Common Findings, continued Property inventory findingsAuthority/Law: 2 C.F.R. 200, Uniform Grant Guidance, 200.313Equipment and EDGAR, Section 80.32 Equipment, (d) (1)oIncomplete or lack of inventory for equipmento Property not properly taggedo Lack of procedures for properly disposing certaininventory items Procurement findingsAuthority/Law: 34 CFR 80.36(b) – Procurement Standardso Lack of policies and procedures for contracting and/orpurchasing goods and serviceso Timesheets were not signed by the employee or the supervisoro Executive director approved his/her own travel authorizationformso Several checks exceeded 10,000 and weresigned only by the executive directorwww.FLDOE.org35
Common Findings, continued Inadequate data quality/reporting findingsAuthority/Law: Proviso language in the annual GeneralAppropriations Act Workforce Education, Aid to LocalGovernments Workforce Development from GeneralRevenue Fundo Lack of timely and accurate reporting of Workforce DevelopmentInformation System (WDIS) datao Over-reporting of instructional hours Student records findingsAuthority/Law: The Family Educational Rights and PrivacyAct (FERPA)(34 Code of Federal Regulations (CFR) Part99.31o Student records were not accessible to compliance teamwww.FLDOE.org36
Common Concerns Last minute spending students must benefit No staff development plans No leadership succession plans Lack of coordination among MIS/data, program andfinancial professionals Outdated textbooks Lack of classroom supplies Outdated policies and procedureswww.FLDOE.org37
Common Concerns - continued Lack of attention to off-site location resource needs Websites out-of-date Physical storage space issueswww.FLDOE.org38
Common Best Practices Discovered in OnsiteMonitoring Visits to Agencies Innovative uses of technology Varied teaching/instructional practices Continued collaboration with business and industrywww.FLDOE.org39
Monitoring Reports Monitoring reports are available /compliancewww.FLDOE.org40
Tools and Resources Carl D. Perkins Career and Technical Education ImprovementAct of kins iv text.pdf Workforce Innovation and Opportunity Act of 2014http://www.doleta.gov/WIOA/ Education Department General Administrative eg/edgarReg/edgar.htmlwww.FLDOE.org41
Tools and Resources - continued Federal Uniform Grant Guidance (Uniform AdministrativeRequirements, Cost Principles, and Audit Requirement forFederal eral-awards Florida Department of Education, Quality Assurance lt-edu/compliance Florida Department of Education “Green tsprocurement/grants-managementwww.FLDOE.org42
Quality Assurance and Compliance TeamDr. Shahrokh Massoudi – (850) 245-9056Judieth Taylor – (850) 245-9025LaStacia Spencer – (850) 245-9036Michael Swift – (850) 245-9051Rod Duckworth, ChancellorDivision of Career and Adult EducationGloria Spradley-Brown, ChiefBureau of Grants Administration and Compliancewww.FLDOE.org43
[ Q & A]We welcome your comments,feedback, and suggestionsThank you!www.FLDOE.org44
www.FLDOE.orgwww.FLDOE.org45
program monitoring scheduled for Fiscal Year 2016-17. www.FLDOE.org 6 Fiscal Years and Programs Monitored Fiscal Years (FY) monitored: . Agency Name: Sunshine State College Target Year: 2014-2015 (Monitoring Year 2016-2017) Metric Scaling Point Value Point Value Assigned (PVA) Weight Total Metric Points
Provider Transition Plan (PTP) System PTP #AD-003910 Provider Information * Mandatory (required) fields below are marked with an asterisk. Legacy Provider ID * 0 New Provider ID * 0 Provider Name * Demonstration Provider Provide
Medicine provider, but they had insufficient data (i.e., the provider group does not have enough commercial health plan claims data to be evaluated, as required by the statistical requirements of the Provider Excellence Program; the provider group did not have enough quality data; or the provider group does not have enough cost-efficiency data). 3.
Provider ID: 1457472029 Provider Gender: Male Accepting New Patients: Yes Anthony Euser, DO 2801 Purcell St Brighton, CO 80601 303-659-7600 Adams County Provider ID: 1588634810 Provider Gender: Male Accepting New Patients: Yes John Fontenot, MD 1860 E Egbert St Brighton, CO 80601 303-659-4000 Adams County Provider ID: 1033373410 Provider Gender .
OEPA-B392346-X Safety Equipment Education and Training 3 Course Approval Number Course Name Contact Hours Training Provider: A.E. Ehrke & Co Provider'S Phone Number: 440-248-9400 . Training Provider: AMP-OHIO Provider'S Phone Number: 614-337-6222 Provider's Address: 2600 Airport Dr, Columbus, OH, 43219
FLORIDA WETLAND PLANTS, AN mENTIFICATION MANUAL can be purchased from the University of Florida, Food and Agricultural Sciences. 1-800-226-1764, P.O. Box 110011, University of Florida, Gainesville, Florida 32611-0011. Introduction For use the the manual: FLORIDA WETLAND PLANTS, AN mENTIFICATION MANUAL
The Annual Florida Equity Report is required under Florida statutes as follows: The Florida Educational Equity Act (Section 1000.05 F.S.) and the Florida Board of Governors Regulation 2.003 Equity and Access. The Uni-versity of South Florida System (USF System), which is comprised of three institutions USF Tampa, USF St.
1) Explain the term ‘Spring Boot’. It is a Spring module that offers Rapid Application Development to Spring framework. Spring module is used to create an application based on Spring framework which requires to configure few Spring files. 2) Mention some advantages of Spring Boot Here are som
Spring Volume 22 Number 3 Summer Volume 22 Number 3 Convention Volume 23 Number 1 1988 Winter Volume 23 Number 2 Spring Volume 23 Number 3 Summer . Spring Summer Fall 2015 Winter Spring Summer Fall 2016 Winter Spring Summer Fall 2017 Winter Spring Summer Fall 2018 Winter Spring Summer Fall . Author: Joan Thomas
