Why are Hawai‘i schools replacing the paper-and-pencil tests with online testing?

• Online testing will provide immediate feedback to teachers and other educators about student performance while they can still use the information to help target instruction.
• Moving online will allow each student up to three opportunities to take the reading, mathematics, or science assessments, so teachers can use information from the first opportunity to target instruction before the next opportunity. Schools will determine how many opportunities students get to take each assessment (although students must take each required assessment at least once). If students take an assessment more than once, the highest score will count towards Adequate Yearly Progress. Students will not see the same test items more than once.
• Online testing provides more flexibility in administration. Schools will be able to administer part of an assessment one day and the rest on another. Schools may not have to change bell schedules to administer the assessments. Students can stop at different points in an assessment and assessments can be given at any time of the day.
• Online testing is less expensive and will save the Department of Education (the Department) millions of dollars. At the same time, online assessments provide educators with more of the information that they need to help students succeed.

Are the Hawai‘i State Alternate Assessment and the Hawaiian Aligned Portfolio Assessment also going online?

• The current Hawaii Aligned Portfolio Assessment (HAPA) for Reading and Mathematics will be discontinued after the spring 2010 administration. The grades 3 and 4 HLIP students will take the online Hawaii State Reading, Mathematics, and Science Assessments in the Hawaiian language during the 2010–2011 school year. Details about online testing in the Hawaiian language will be communicated during the second semester of 2009–2010 to the Hawaiian Language Immersion Program (HLIP) teachers and administrators.
• A new Hawaii State Alternate Assessment (HSAA) will be field tested during fall 2010 and administered during the second semester of 2010–2011. An online system for submitting student evidence will be used.

When and where will the students take the online tests?

• The HSA Online Field Tests will be taken only once per subject between February 16 and May 26, 2010, by students who are currently enrolled in the tested grades. Schools do not have to field test all the students at once (each student will get a unique field test form, so the tests will stay secure), and students can even stop a field test and complete it another day.
• For the 2010–2011 school year, students will take the Hawai‘i State Reading, Mathematics, and Science Assessments online. The assessments will be available from mid-October through May. Schools must ensure that all students in grades 3–8 and 10 take the Reading and Mathematics Assessments at least once and that all students in grades 4, 8, 10 and any 9th, 11th, and 12th grade student enrolled in a biology course take the Science Assessment at least once. Schools have the option of administering each subject to a student up to three times.
• Students can be tested in any room that provides a quiet environment where other students are not participating in learning activities and where there are enough computers for a group of students, plus one computer for the Test Administrator. Some schools will use computer labs, and others will use mobile computer carts brought into classrooms.

Where can I find out more information about the plans for the spring 2010 online field test and the 2010–2011 online Hawai‘i State Assessments?

• As the Department moves forward with this important initiative, we will post relevant information and announcements on the Hawai‘i State Assessment Web site.
• Schools may contact the American Institutes for Research’s Help Desk at 1-866-648-3712 or e-mail HSAHelpDesk@air.org with any other questions.

Has anyone at the district or state level previewed the test?

The Hawaii Department of Education has conducted several different types of user testing for the online testing system and reviews the content of all tests.

How many computers will we need to conduct the testing?

• Remember, not all students will have to test at the same time, so you will need fewer computers than you may expect. A good rule of thumb is about one computer for every five to 10 students. Computer labs set up with enough computers to accommodate a class can easily test four classes in one subject every two days. So, for example, a school with one computer lab and 200 students per grade should schedule about one week to test each grade in each subject.
• The Department recommends that each school have about one computer for every five to 10 students; however, as the example above shows, even fewer will work. When counting computers you should only count computers in group settings where groups of students can be tested together, and at least one computer should be reserved for the Test Administrator. See the Information about Scheduling Options for Test Coordinators brochure for more information.

Our computers are pretty old. Is that okay? What do schools need to do technology-wise to get ready for the online field test in February? Is there a checklist for schools to refer to in preparing for this change? Do schools need to install new servers, software or build out new infrastructure?

• The Department has chosen an online testing system that works well with older computers. See the Information about Online Testing for Technology Coordinators brochure for specific information about hardware, operating system, and other technology requirements.
• Also note that you MUST install a secure browser on each computer students will use for online testing. These browsers prevent students from accessing other applications on the computer while they are taking a test. Click here for information on browser installation and FAQs about browsers.

What if my school does not have a Technology Coordinator? Who can make sure our technology is sufficient to administer an online field test?

• The Department has chosen an online testing system that requires very little technology support from schools. Your school does not need to have a full-time Technology Coordinator or someone with an extensive understanding of IT processes. It is recommended, however, that your school designate a single point of contact to ensure your school is 100% prepared for the first field testing day, as well as for efficient communication with the Department and the American Institutes for Research.
• The Department’s communication materials will provide explicit instructions addressed to non-IT personnel on how to prepare for the online field tests.

I’m concerned that we may experience possible glitches and technology issues at my school during the field tests. What happens if the power goes out? Or a student accidentally switches off the computer?

• The Department has selected an online testing system that will not lose data if there is an Internet outage or power loss. If the Internet goes out, students will have to complete their field tests another day; however, the answers that they already provided will have been saved and the student will restart where he or she left off.
• The flexible field testing schedule will let schools decide when to field test and for how long. The Department expects that many students will begin a field test on one day and continue on another even when there are no technology problems.

The minimum recommended screen size is 11.6 inches (minimum supported resolution is 1024 x 768). What will happen if a teacher uses his/her set of netbooks that have screens smaller than 11.6 inches?

Individuals using netbooks with smaller screen sizes will still be able to access HSA Online systems, but may need to scroll down or across to see the complete screen. Students can also use the zoom tool in the Training Test and in the Student Interface during testing to enlarge the content on the screen if needed.

How do I download and install the secure browsers?

There are several methods you can use:

• You can go to each computer to be used for testing, access the Internet, and download the browser at: http://www.alohahsa.org/online/browsers/default.html.
• You can save the browser on a media device and then copy it on each computer.
• You can save the browser to a network folder and then copy it on each computer.
• You can push the browser out to all networked computers through a network by copying browser files from the network to individual computers or through third-party programs to run the installers, such as Apple Remote Desktop). Network installation instructions are available at http://www.alohahsa.org/online/networkInstallation.html.

How do I disable pop-up blockers?

Pop-up blockers must be disabled to access TIDE, the Test Administrator Interface Training Site, the Test Administrator Interface, and Participation Reports. To disable pop-up blockers, go to:

• Firefox: Tools > Options > Content
• Internet Explorer: Tools > Pop-up Blocker
• Safari: Edit > Block Pop-up Windows

Do we have/need audio devices for the test?

Audio devices are not available or needed for the field test.

Will the online assessments still have constructed response questions?

• To report test scores back immediately, all items must be scored by the computer.
• This spring, the Department will field-test some machine-scored constructed response questions in each grade and subject. Depending on the results of the field tests, these questions may be included on the 2010–2011 online Hawai‘i State Assessments. Go to the Student Interface Training Site (Training Test) to see some of these types of questions.

Will students need rulers, protractors, calculators, or other tools for the online mathematics field test?

• Students may use four-function calculators but not rulers, protractors, or other tools during the spring 2010 online mathematics field test. For operational testing, beginning in school year 2010–2011, a pop-up calculator will be available to students during testing, so they will not need a separate calculator or any other tools. Students may use scratch paper during both the online mathematics field test and the operational testing

How will students and teachers get results back?

• For the spring 2010 field tests, no results will be reported for students. Once the online tests are operational in school year 2010–2011, results will be available through an online reporting system. Every complex area superintendent, school principal and teacher will have access, and the system will show results for their schools, classes and students.
• Results will be available immediately after testing. Teachers will log on to see how their students performed.
• Parents will still receive a printed score report at the end of the school year.

Is there a guide for principals on how to manage the transition to online testing?
Are there any communication materials to help schools inform students and parents about the online field tests starting in February 2010 and the online Hawai‘i State Assessments starting in school year 2010–2011?
Are there any training materials that principals can use to prepare teachers and Test Administrators for conducting the spring 2010 online field tests?

• Yes, a number of different training and communication resources for principals and others have been developed regarding online testing, including user guides, manuals, brochures, and training sites. Go to http://www.alohahsa.org/online/resourcesGeneral.html to view all of the available information.

Will schools be able to see the online testing system before February 2010 so teachers, test administrators and students can become familiar with it before completing the field tests?
Will the grade level that will take the test next year be able to practice (e.g. 2nd graders to take test to prepare for the upcoming year)?

• Yes. A training test system is available. The Department encourages every teacher, Test Administrator and student to try it out before the field test begins. No password is needed to try out the training test.
• Also, anyone who will be administering a test to students during the field testing or operational testing must pass an online Administrator Certification course. To access this course, TAs will need a username and password. Test Coordinators must go into the TIDE system and add anyone who will administer a test as a Test Administrator. Once added, the person will receive an automated email with a username and password that s/he can use to access all HSA online systems, including the online TA Certification course. Test Administrators will not be able to log into the Test Administrator Interface without passing this course. Please note that this does NOT include proctors because they will not be using the online testing system. Proctors will only assist with monitoring students during testing.

Can a Test Coordinator confirm which Test Administrators have passed the Online TA Certification course?

• Yes, starting February 16, 2010, Test Coordinators will be able to use the TIDE system to verify which Test Administrators in the school have passed the Online TA Certification course. This information will be available in the “Trained” column in the “View Users” tab in TIDE. This column will be set to YES if the Test Administrator has passed the test or NO if he or she has not passed the test.

Are hard copies of all the online user guides and manuals available?

For the online field test, only pdfs are available online. Schools will need to download and print their own copies.

How can we ensure that students do not cheat when they are taking a test on a computer?

• The Online Field Test Administration Manual describes the security procedures in detail.
• Just like with paper tests, Test Administrators will be responsible for proctoring and ensuring that the students taking a test are, in fact, who they say they are.
• Students will take a test using a special browser that prevents them from doing anything on the computer except taking the test. This browser will not allow students to copy questions or look up answers.
• While taking a test, students will see different questions in different sequences, so copying from one another will not help them.
• If a student ends a testing session before answering all of the questions, the student will not be able to review completed questions when finishing a test during a subsequent session.

What if students cannot use a mouse?

• Students can navigate the online tests using a mouse or the keyboard. A list of keyboard shortcuts is provided for students within the online testing system.

What if students are absent during an online test administration?

• Students can take a test anytime during the testing window. Because of the adaptive nature of the online testing system, different students may see different questions in a different order, making test security less of a concern and therefore easier to test students at different times.

Can students use extended time?

• Yes, all students can use as much time as needed to complete the online tests. Testing may be split across multiple sessions so that the testing does not interfere with class schedules. Each test must be completed within 45 days of starting the test.

What accommodations are available for ELL, Special Education, and Section 504 students?

• The full list of accommodations that will be provided during the administration of the Hawai‘i State online field tests can be found in the Online Field Test Administration Manual. The list identifies the student population for whom the specific accommodation may be provided and includes common examples.
• Some of the features of the new online testing system will allow all students to interact with the test in new ways. ALL students will be able to use the following features for the spring 2010 online field tests:
• Zoom in to test questions—students can make field test questions (text and graphics) larger by clicking on the Zoom icon
• Highlight passages (or sections of passages) in the Reading, Mathematics, and Science Assessments
• Pause the test and return to the question they were on (Note: If a test is paused for more than 20 minutes, students will not be allowed to return to previous questions.)
• Cross out response options—students can eliminate response options by using the strikethrough function
• Mark a question for review—students can use the flag function to mark a question to return to it later (Note: If a test is paused for more than 20 minutes, students will not be allowed to return to marked questions.)
• Take student-initiated breaks
• Take as much time as needed to complete a test

How do students log into the online testing system?

• Students must use their legal name (as it appears in eSIS), their 10-digit state student ID number, and a testing session ID that will be generated by the Test Administrator. Student information will be pre-loaded from eSIS into the online testing system. If there is any problem with the student data in the online system, it must be corrected in eSIS. Information from eSIS will be automatically updated each night in the online testing system.

What if students transfer during testing?

• If students transfer from school to school during online testing, the system will keep a record of any complete or incomplete tests. Students can resume testing at their new schools where they left off in any incomplete tests. Test Coordinators will be able to see from the Participation Reports where the student was in testing. Again, however, student information must be updated in eSIS to be accurately reflected in the online testing system.

Sometimes students talk about the test outside of school. Even though students are supposed to have different items, wouldn't the students have an advantage if a particular reading or math problem appears on their screen the day after their discussion?

Given that the online test is adaptive and that there are numerous questions, different students will see different questions in a different order. The opportunity of students seeing the same items at the same time is limited. Whether you are testing online or on paper, test security is always a concern, and we hope that schools will impress upon their students the need to maintain it.

When the online test becomes "live" in 2010-11, how will I know which students still need to take the online test before the school year ends?

The online testing system automatically keeps track of which students have and have not completed their tests. Test Coordinators will have access to this information through the Participation Reports application. Participation reports will show which students have completed tests in each subjects, how many times they have taken the tests, and their scores for each testing opportunity. The reports will also show which students have not completed their tests. A User Guide explaining how to access and read these reports is available.

What if students access other websites or applications during testing?

The secure browser prevents students from accessing any other applications or navigating to other websites during testing.

Where do I find the 10-digit state ID number for a student? Can eSIS export students’ ID numbers?

The state student ID number (SSID) comes from the VAX and is available to schools through eSIS. Your clerk or registrar should be able to provide a roster of SSIDs and student names.

How does student information get into the testing system? Do I need to enter it

Student information is uploaded nightly from the Hawaii Department of Education into the HSA Online testing system. Test Coordinators or Test Administrators do not need to enter any student information. If a Test Administrator or Test Coordinator notices that student information is incorrect during testing, they will need to make the change in eSIS and the updated information will be uploaded to HSA Online testing system overnight.

Is the test going to be available only at certain time of day?

No, tests can be given at any time of the day. The school determines the testing schedule.

Can a Test Coordinator create the tests sessions for teachers (Test Administrators) using their passwords prior to their day and time of testing?

No, Test Coordinators cannot create test sessions ahead of time for Test Administrators. Test sessions can only be created on the day of testing. Just a reminder, Test Administrators should NOT give their passwords to anyone (even Test Coordinators). Test Administrators can create sessions on the day of testing before the actual testing session if they wish. You may find this short reference guide for TAs useful: http://www.alohahsa.org/online/resources/Quick_Reference_Guide_for_TAs.pdf

If a student needs more time and has to continue testing later can a different Test Administrator continue to test the student later?

The student can test with anyone who is certified to administer an HSA Online test. The student can complete a test that was begun in one session in a different session. The HSA Online testing system will keep track of which tests students have started and completed and will allow students to access an incomplete test in a later session. The test does not "belong" to a session, but rather to a student. The Test Administrator should start a new session that offers the test in question (e.g., grade 4 reading or whatever), and the student should join the new session. If the student has started a test, he or she will be offered the opportunity to resume it.

Will I be able to print a master list of all students in all grades who did not finish testing so that I can schedule make-ups or completion sessions?

Test Coordinators will be able to access participation reports that include information for all students who may not have completed testing by selecting report filters. A Participation Reports User Guide is available to show how to generate these reports.

If a Test Administrator is administering a test to some students in a class and another Test Administrator is in charge of administering the test to the students needing accommodations from that class, do the groups need to use the same test session ID?

Students from the same class who take tests at different times or with different Test Administrators do not need to use the same test session ID. In this example, the person testing the accommodation group can create a different test session with his/her login and administer the test to students that way. If each Test Administrator is in a different computer lab or setting, each would need to create a testing session and when the session is created a test session ID is provided by the system that is to be used by students in each of the sessions created by the Test Administrator that has logged in to create the session.

Will schools be responsible for the online field testing of students who are receiving educational services off campus?
This information can be found on pages 17 and 18 of the Online Field Test Administration Manual. For the spring 2010 online field tests, the following populations are exempt:

1. Alternative Program Students
2. Grade 31
3. Hawaiian Language Immersion Program students in grades 3 and 4
4. Home/Hospital Instruction Students
5. Home Schooled
6. Serious Disciplinary Action Status Students
7. Other Exempted Students:
   1. A student who would normally take the Braille version of the assessment. The student must have a documented organic eye impairment and be receiving the services of a teacher for the visually impaired.
   2. A student who has a significant medical emergency.
   3. A student who is receiving services at an out-of-state residential program that is approved by the student’s Individualized Education Program (IEP).
   4. A student who meets the requirements of Regulation 4140, Exceptions to Compulsory School Attendance, if the student withdraws from the Hawai‘i public school system before the first day of the official field testing window (2/16/10).
   5. A student who is dismissed, as opposed to suspended.
   • A dismissed student is permanently expelled from the Hawai‘i public school system and may not re-enroll.
   • A suspended student is temporarily removed from the school campus where the student is enrolled and may return after the suspension has been served.
   6. A student who is exempt from participating in the Hawai‘i State Online Field Tests at the written request of the student’s parents.

What if it takes students more than 20 minutes to do one problem? Will they be timed out?

If a student is inactive on a test for 20 minutes, the system will ask if s/he wants to continue testing. If the student responds yes, then s/he will not be logged out. If the student does not respond, s/he will be logged out in order to protect test security and privacy. If this happens, they can simply log back in and pick up where they left off (they can start with the question they were working on when they were timed out). If students are logged out, they will not be able to change answers to questions they answered previously. You can also instruct students to raise their hands and ask for help if they see a message on the screen that they are not sure how to handle.

What do I do if something goes wrong during testing? What if students are cheating?

Testing irregularities should be reported to your Test Coordinator, who will then report the irregularity to Systems Accountability Office, Student Assessment Section administrator, Kent Hinton, at (808) 733-4100. The form for reporting testing irregularities is posted on AlohaHSA at http://www.alohahsa.org/online/resources/Spring_2010_HSA_Online_Field_Test_Irregularity_Form.pdf.

Can Test Administrators help students log in?
Students need to log into the system using their legal first name and SSID number. Test Administrators may assist students with this if necessary.  This information could also be provided to students ahead of time on a card to help them type it in accurately.  Please remember that student ID numbers are confidential information and cards would need to be collected and stored in a secure location or shredded.

Can Test Administrators help students with the constructed response questions?  For example, if students have difficulty placing items on a grid or typing their response, can the TA assist them?
We recommend that schools use the practice test to identify any students for whom it appears that typing their responses or placing items on a grid may cause difficulty.  These students should be tested separately.  TAs may assist these students, similar to the way in which a scribe would assist a student needing this accommodation.
 
Can Test Administrators read test questions in Mathematics for any student?
Similar to the paper-and-pencil procedures, Test Administrators can read Mathematics questions to students if they request it.
 
How many students can be tested at one time?
In general, this will depend on the number of computers, Internet connection, and the space available in the school.  However, schools should follow good testing practice, limiting distractions, allowing sufficient space, and ensuring that Test Administrators can adequately oversee the number of students testing.