reading proficiency test - transparent language · 2018-02-23 · reading proficiency test guide...

Reading Proficiency Test

Low to Mid Range (LMR) ILR Levels 0+ to 3

Very High Range (VHR)

ILR Levels 3 to 5 Secure Versions A Familiarization Guide for Examinees

TABLE OF CONTENTS

Table of Contents ............................................................................................................................ 2

Introduction .................................................................................................................................... 3

Test Design .................................................................................................................................. 3

Test Content ................................................................................................................................ 3

Test Format ..................................................................................................................................... 4

Sections: ...................................................................................................................................... 4

Questions: ................................................................................................................................... 5

Answer choices: ........................................................................................................................... 6

Navigation ....................................................................................................................................... 9

Progress Menu ................................................................................................................................ 9

Scoring ....................................................................................................................................... 10

Instructions for Taking the Test .................................................................................................... 11

Technical Requirements ............................................................................................................ 11

Accessing the Test: .................................................................................................................... 11

The Disclaimers and pre-test questions .................................................................................... 11

Disclaimer: ........................................................................................................................... 12

Non-disclosure Statement ................................................................................................... 12

Pre-Test Questions: ................................................................................................................... 13

Start Test ................................................................................................................................... 13

Question Screens ....................................................................................................................... 14

The Section Review Screen ....................................................................................................... 14

Stop/Continue test .................................................................................................................... 16

Logout ........................................................................................................................................ 16

Results ....................................................................................................................................... 16

ILR Reading Levels 0+ to 5 Descriptions ........................................................................................ 17

Reading 0+ (Memorized Proficiency) ........................................................................................ 17

Reading 1 (Elementary Proficiency) .......................................................................................... 17

Reading 1+ (Elementary Proficiency, Plus) ................................................................................ 17

Reading 2 (Limited Working Proficiency) .................................................................................. 17

Reading 2+ (Limited Working Proficiency, Plus) ....................................................................... 18

Reading 3 (General Professional Proficiency) ........................................................................... 18

Reading 3+ (General Professional Proficiency, Plus) ................................................................. 18

Reading 4 (Advanced Professional Proficiency) ........................................................................ 19

Reading 4+ (Advanced Professional Proficiency, Plus) ............................................................. 19

Reading 5 (Functionally Native Proficiency) .............................................................................. 19

Reading Proficiency Test Guide Low to Mid Range (LMR) ~ Very High Range (VHR)

of 19 Developed by Avant Assessment, LLC

INTRODUCTION

This Familiarization Guide for the Low to Mid Range (LMR) and Very High Range (VHR) reading proficiency

tests is designed to provide prospective examinees with information about the test, which is delivered over

the Internet. This guide contains general information about various aspects of the test including: the

design, the format, the length, the content, types of questions, the skills tested, and procedures used in

scoring and reporting the scores. In addition, screen shots of what the examinees will see while taking the

test on the computer, along with information on testing procedures, are provided.

These tests are designed to assess the general language proficiency in reading. The tests combined measure

proficiency in levels 0+ through 5, as defined by the Interagency Language Roundtable (ILR) Skill Level

Descriptions (see page 17). All tests are delivered over the Internet.

Test Design

Each examinee will be presented with 20 to 30 authentic reading passages in the LMR test. Each passage

has 1 to 3 questions, depending on the length and difficulty level of the passage. One question will be

displayed at a time on the right half of the screen, next to the passage. Each question is worth between one

and three points.

The test is timed. The timer will start after the test introduction screens and pre-test questions have been

completed. A countdown clock indicating the time remaining displays next to the Question number at the

bottom of the screen.

If the examinee achieves an ILR level 2 or higher in the LMR test, the examinee will automatically move to

the VHR test. The examinee will be presented with 10 to 15 authentic reading passages in the VHR test.

Each passage has 3 to 5 questions depending on the length and difficulty level of the passage. One question

will be displayed at a time on the right half of the screen, next to the passage. Each question is worth

between one and three points. The test is timed. The timer will begin when the examinee is presented with

the first test question in the VHR test.

Test Content

The test is designed to measure proficiency in the language being tested regardless of how it has been

acquired. Test content is not tied to any particular language-training program or curriculum.

Passages included are from authentic materials including, but not limited to, newspapers, the Internet,

novels and short stories. Passages cover a broad range of content areas, including social, cultural, political,

economic, geographic, scientific, and military topics.



ALL passages in the LMR and VHR tests are presented in the language the examinee is being tested. The

questions in the LMR test are primarily written in English and ALL questions in the VHR test are written in

the language the examinee is being tested.

TEST FORMAT

Sections:

The tests are delivered in computer-adaptive format. The examinee’s proficiency level can be identified by

answering fewer questions and with a higher degree of precision than in traditional, fixed-form tests.

The examinee will take the LMR test in three sections. If the examinee achieves an ILR Level 2 rating or

higher, the examinee will automatically move to the VHR test and encounter three more sections. Each

section is administered automatically by the computer, based upon the examinee’s responses to the

previous section.

Within each section, the examinee is free to move from question to question within the section, reviewing

and making changes as they wish. Before finishing the section, the examinee can return to any question in

the section to review and/or modify the answer(s). A review screen will display when the examinee has

reached the end of the section to allow them to review the section they have just completed or to move on

to the next section. Once an examinee moves on to the next section, the examinee will not be able to

return to the previous section.

Each section is composed of a set of questions that are worth between one and three points each for a

total of ten points per section.

Continued on next page…..



Questions:

Each question will contain:

A short statement, appearing before each passage. Its purpose is to identify the context from

which the passage is taken. The statement will be written in English in the LMR test and in the VHR

test it will be written in the language being tested.

A passage, written in the language being tested. The maximum length of a passage in the test is

approximately 500 words. Most of the passages are much shorter than the maximum length.

A comprehension question: Each question is intended to evaluate the examinee’s comprehension

of the passage or an aspect of the passage. Each question prompt appears as a question or an

incomplete statement. Each question prompt in the LMR test is written in English. Each question

prompt in the VHR test is written in the language being tested. Three types of questions are

included in the test: Multiple Choice, Breadth and Depth, and Highlight and Select.

Example of Item Format

Passage

This statement provides context to the passage



Answer choices:

For Multiple Choice questions, there is a question prompt and four response options. The prompt may

appear as a question or as an incomplete statement. The four response options are displayed on the screen

with a radio button next to each option. Of these options, there is only one best answer to the question. To

select the best answer, examinees can click on a radio button. They can change their selection by clicking

on a different radio button.

In the LMR test all of the prompts are written in English with response options primarily written in

English. In the VHR test, all prompts and answer options are written in the language being tested.

Multiple Choice question prompt



For Breadth and Depth questions, each question prompt is followed by a list of six response options. The prompt may appear as a complete question or as an incomplete statement. Each question is designed to have three correct answers. Examinees must click on a check-box to select a set of three equally correct answers. A maximum of three answer choices may be selected at any one time. Examinees can change their selection by clicking on a checked box to deselect that answer and clicking on a

different check-box to select another answer.

In the LMR test all of the prompts are written in English with response options primarily written in

English. In the VHR test, all prompts and answer options are written in the language being tested.

Highlight and Select questions consist of a sentence with one gap that examinees are expected to fill in. In

order to complete the sentence, a number of phrases in the passages are selectable. It is possible that there

is more than one phrase in the passage that correctly completes the sentence. The examinee will only be

able to select and submit one of these correct answers; however, each correct answer is given equal credit.

In the LMR test, the sentence with a gap to fill will be written in English. In the VHR test, the

sentence with a gap to fill will be written in the language being tested.

Click to uncheck

Breadth and Depth question prompt



Examinees must move their mouse over the words in the passage. If a phrase is selectable, the text will be

shaded and the hand-shaped cursor will appear as the examinee moves their mouse across it.

The examinee will use their mouse to select a phrase in the passage. Once clicked, the selected phrase is

highlighted and automatically appears in the question’s response field, filling the gap.

Incomplete; Highlight and Select question

Completed; Highlight and Select question



NAVIGATION

The software presents the passage on the left and one question at a time on the right. Each question is

identified at the bottom of the screen with a unique question number, defined by two parts: the section

number and the item/question number. The section number identifies which of the three sections the

examinee is encountering in the test, marked as “section x of y”. The item/question number identifies the

sequence of the current question out of the total number of questions assigned to the section, marked as

“question x of y”.

At the bottom of the screen are the [BACK ] button and [ NEXT] buttons, allowing examinees to review

or skip questions appearing on the test.

PROGRESS MENU

A Progress menu is presented on the left side of the screen that provides one button for each of the

items/questions in the test section. The button coinciding with the question number that the examinee is

encountering in the test will be shaded blue. When the examinee answers the question the examinee will

automatically be presented with the next item/question in sequence for the test section by clicking the

[ NEXT] button or by clicking the next item/question button in the Progress menu.

To navigate to a specific question in the section, select the question button in the Progress menu.

Each of the buttons on the progress menu are labeled with a circle immediately to the right of the question

number “Item x”. The color of the circle indicates the progress of the particular question.

The circle will be empty if the examinee has not provided an answer to the question. When the examinee

provides one answer to a Multiple Choice or Highlight and Select question, the circle will fill in green,

identifying the question as complete. When the examinee provides three answers to a Breadth and

Depth question, the circle will fill in green, indicating the question is complete. When the examinee

provides one or two answers to a Breadth and Depth question, the circle will fill in orange, indicating the

question is partially complete.



Scoring

The Test Administrator will provide results to the examinee.

Each question is scored correct or incorrect with 1 to 3 points per question. Scores are calculated at the

completion of each section and the software’s selection of the next section is based on that result.

LMR: Final scores for all sections combined are reported in terms of ILR levels 0+, 1, 1+, 2, 2+, or 3.

VHR: Final scores for all sections combined are reported in terms of ILR levels 3, 3+, 4, 4+, or 5. If the

examinee does not score high enough to obtain a 3, they will be given the result, “less than 3” or “No Pass”

score.

Scores reflect functional language proficiency in reading as defined in the current ILR Skill Level Descriptions

(see page 17). Scores cannot be interpreted to indicate proficiency in listening, speaking, or writing, nor do

these results describe the examinee’s job-related performance or ability to perform specific language-

related tasks under special circumstances (such as using supplemental materials and information sources).

Scores on the test are not based exclusively on the number of questions answered correctly but also take

into account the difficulty level of the passages and progress through the stages of the test. There is no

penalty for incorrect answers; only correct answers are evaluated in assigning a final score. The examinee

will benefit from attempting to answer every question.

Partially complete

Complete

Incomplete

Current Question



INSTRUCTIONS FOR TAKING THE TEST

Technical Requirements

The minimum system requirements are:

Windows - Internet Explorer 11+

Screen resolution: 1024 x 768 minimum required

Mac: Not supported

Accessing the Test:

Navigate to the test delivery Web site.

As directed by the testing proctor.

Test Code: Provided by the Test Administrator

Password: Provided by the Test Administrator

Personal Identifier: Provided by the Test Administrator.

The Disclaimers and pre-test questions

Prior to starting the test, the examinee is asked to respond to a number of disclaimer prompts and pre-test

questions.



Disclaimer:

Non-disclosure Statement

Click to confirm that you have read and understand the Test Administration and Non-Disclosure statements, then click [NEXT>>].

Click to confirm that you have read and understand the Disclaimer, then click [NEXT>>].



Pre-Test Questions:

Start Test

Click the [Start Test] button. The timer will begin when the examinee clicks [Start Test].

Please click the button that best describes you and your language skills. Click [NEXT>>] to continue.

The examinee may click “Edit Profile” to make changes to the answers

provided to the Pre-Test Questions



Question Screens

The examinee will need to answer the question to proceed. S/he will click [ NEXT] to move forward,

or [BACK ] to review the previous question. The examinee may also navigate between questions by

selection the Item/Question buttons in the Progress Menu (See page 10).

Upon completing the last test question in the section, the examinee will finish the section by selecting

the [ FINISH] button. The examinee will be presented with a Section Review Screen with the

opportunity to review the progress of the section.

The Section Review Screen

At the completion of each section, the examinee is presented with the opportunity to review all responses

within the section or to respond to anything that was skipped or incomplete. The section review page lists

all of the questions in the section. Each question will have an indicator, indicating if the question is

complete; YES (complete), NO (blank, no answer given), PARTIAL (partially complete)

Selecting the [BACK ] button will return the examinee to the test questions in the section. To return to

the section page to complete the section, navigate to the last test question in the section and select the

[ FINISH] button.



There are three sections in the LMR test and three sections in the VHR test. Upon completing section 3 of

the LMR test if the examinee achieved an ILR score less than 2, the Proficiency test is complete and the

examinee will be presented with the Test Complete Page.

If the examinee achieved an ILR score of 2 or greater in the LMR test, the examinee will automatically move

into VHR test and begin with “Section 1 of 3 – Questions 1 of xx” in the VHR test.

Upon completing the VHR test, the Test Complete page is presented and the examinee may Log out.



Stop/Continue test

The examinee may pause taking the test by clicking on the [STOP TEST] button at the top of the test

question screen. When the examinee clicks the [STOP TEST] button, the timer for the test instance will be

paused and the examinee will be presented with a screen to continue testing. To continue the current test

instance the examinee clicks the [CONTINUE CURRENT TEST] button. At which time, the timer will resume

and the examinee will be entered into the test at the point they stopped the test.

The examinee has the option to start the test again from the beginning

by selecting [START A NEW TEST]. The examinee must use caution as

starting a new test will delete ALL answers the examinee has provided

for the test instance and the examinee will be presented with the first

question of the test. The time will also reset and the examinee will have

the fully allotted time to complete the test.

Logout

At any time the examinee may log out of the test by selecting the [LOGOUT] button in the upper right

corner of the test. Upon selecting the [LOGOUT], the timer will stop and the examinee will be presented

with the LOGIN screen. The examinee may resume his/her test instance by logging in with the same Test

Code, Password and Personal Identifier.

Results

The test administrator will provide test results to examinees.



ILR READING LEVELS 0+ TO 5 DESCRIPTIONS

(from www.govtilr.org/Skills/ILRscale4.htm)

Reading 0+ (Memorized Proficiency)

Can recognize all the letters in the printed version of an alphabetic system and high-frequency elements of

a syllabary or a character system. Able to read some or all of the following: numbers, isolated words and

phrases, personal and place names, street signs, office and shop designations. The above often interpreted

inaccurately. Unable to read connected prose.

Reading 1 (Elementary Proficiency)

Sufficient comprehension to read very simple connected written material in a form equivalent to usual

printing or typescript. Can read either representations of familiar formulaic verbal exchanges or simple

language containing only the highest frequency structural patterns and vocabulary, including shared

international vocabulary questions and cognates (when appropriate). Able to read and understand known

language elements that have been recombined in new ways to achieve different meanings at a similar level

of simplicity. Texts may include descriptions of persons, places or things: and explanations of geography

and government such as those simplified for tourists. Some misunderstandings possible on simple texts.

Can get some main ideas and locate prominent questions of professional significance in more complex

texts. Can identify general subject matter in some authentic texts.

Reading 1+ (Elementary Proficiency, Plus)

Sufficient comprehension to understand simple discourse in printed form for informative social purposes.

Can read material such as announcements of public events, simple prose containing biographical

information or narration of events, and straightforward newspaper headlines. Can guess at unfamiliar

vocabulary if highly contextualized, but with difficulty in unfamiliar contexts. Can get some main ideas and

locate routine information of professional significance in more complex texts. Can follow essential points of

written discussion at an elementary level on topics in his/her special professional field.

In commonly taught languages, the individual may not control the structure well. For example, basic

grammatical relations are often misinterpreted, and temporal reference may rely primarily on lexical

questions as time indicators. Has some difficulty with the cohesive factors in discourse, such as matching

pronouns with referents. May have to read materials several times for understanding.

Reading 2 (Limited Working Proficiency)

Sufficient comprehension to read simple, authentic written material in a form equivalent to usual printing

or typescript on subjects within a familiar context. Able to read with some misunderstandings

straightforward, familiar, factual material, but in general insufficiently experienced with the language to

draw inferences directly from the linguistic aspects of the text. Can locate and understand the main ideas

and details in material written for the general reader. However, persons who have professional knowledge

of a subject may be able to summarize or perform sorting and locating tasks with written texts that are well

http://www.govtilr.org/Skills/ILRscale4.htm



beyond their general proficiency level. The individual can read uncomplicated, but authentic prose on

familiar subjects that are normally presented in a predictable sequence which aids the reader in

understanding. Texts may include descriptions and narrations in contexts such as news questions describing

frequently occurring events, simple biographical information, social notices, formulaic business letters, and

simple technical material written for the general reader. Generally the prose that can be read by the

individual is predominantly in straightforward/high-frequency sentence patterns. The individual does not

have a broad active vocabulary (that is, which he/she recognizes immediately on sight), but is able to use

contextual and real-world cues to understand the text. Characteristically, however, the individual is quite

slow in performing such a process. Is typically able to answer factual questions about authentic texts of the

types described above.

Reading 2+ (Limited Working Proficiency, Plus)

Sufficient comprehension to understand most factual material in non-technical prose as well as some

discussions on concrete topics related to special professional interests. Is markedly more proficient at

reading materials on a familiar topic. Is able to separate the main ideas and details from lesser ones and

uses that distinction to advance understanding. The individual is able to use linguistic context and real-

world knowledge to make sensible guesses about unfamiliar material. Has a broad active reading

vocabulary. The individual is able to get the gist of main and subsidiary ideas in texts which could only be

read thoroughly by persons with much higher proficiencies. Weaknesses include slowness, uncertainty,

inability to discern nuance and/or intentionally disguised meaning.

Reading 3 (General Professional Proficiency)

Able to read within a normal range of speed and with almost complete comprehension a variety of

authentic prose material on unfamiliar subjects. Reading ability is not dependent on subject matter

knowledge, although it is not expected that the individual can comprehend thoroughly subject matter

which is highly dependent on cultural knowledge or which is outside his/her general experience and not

accompanied by explanation. Text-types include news stories similar to wire service reports or international

news items in major periodicals, routine correspondence, general reports, and technical material in his/her

professional field; all of these may include hypothesis, argumentation and supported opinions. Misreading

rare. Almost always able to interpret material correctly, relate ideas and "read between the lines," (that is,

understand the writers' implicit intents in text of the above types). Can get the gist of more sophisticated

texts, but may be unable to detect or understand subtlety and nuance. Rarely has to pause over or reread

general vocabulary. However, may experience some difficulty with unusually complex structure and low

frequency idioms.ILR Reading Level 3+ to 5 Descriptions

Reading 3+ (General Professional Proficiency, Plus)

Can comprehend a variety of styles and forms pertinent to professional needs. Rarely misinterprets such

texts or rarely experiences difficulty relating ideas or making inferences. Able to comprehend many

sociolinguistic and cultural references. However, may miss some nuances and subtleties. Able to

comprehend a considerable range of intentionally complex structures, low frequency idioms, and



uncommon connotative intentions, however, accuracy is not complete. The individual is typically able to

read with facility, understand, and appreciate contemporary expository, technical or literary texts which do

not rely heavily on slang and unusual questions.

Reading 4 (Advanced Professional Proficiency)

Able to read fluently and accurately all styles and forms of the language pertinent to professional needs.

The individual's experience with the written language is extensive enough that he/she is able to relate

inferences in the text to real-world knowledge and understand almost all sociolinguistic and cultural

references. Able to "read beyond the lines" (that is, to understand the full ramifications of texts as they are

situated in the wider cultural, political, or social environment). Able to read and understand the intent of

writers' use of nuance and subtlety. The individual can discern relationships among sophisticated written

materials in the context of broad experience. Can follow unpredictable turns of thought readily in, for

example, editorial, conjectural, and literary texts in any subject matter area directed to the general reader.

Can read essentially all materials in his/her special field, including official and professional documents and

correspondence. Recognizes all professionally relevant vocabulary known to the educated non-professional

native, although may have some difficulty with slang. Can read reasonably legible handwriting without

difficulty. Accuracy is often nearly that of a well-educated native reader.

Reading 4+ (Advanced Professional Proficiency, Plus)

Nearly native ability to read and understand extremely difficult or abstract prose, a very wide variety of

vocabulary, idioms, colloquialisms and slang. Strong sensitivity to and understanding of sociolinguistic and

cultural references. Little difficulty in reading less than fully legible handwriting. Broad ability to "read

beyond the lines" (that is, to understand the full ramifications of texts as they are situated in the wider

cultural, political, or social environment) is nearly that of a well-read or well-educated native reader.

Accuracy is close to that of the well-educated native reader, but not equivalent.

Reading 5 (Functionally Native Proficiency)

Reading proficiency is functionally equivalent to that of the well-educated native reader. Can read

extremely difficult and abstract prose; for example, general legal and technical as well as highly colloquial

writings. Able to read literary texts, typically including contemporary avant-garde prose, poetry and

theatrical writing. Can read classical/archaic forms of literature with the same degree of facility as the well-

educated, but non-specialist native. Reads and understands a wide variety of vocabulary and idioms,

colloquialisms, slang, and pertinent cultural references. With varying degrees of difficulty, can read all kinds

of handwritten documents. Accuracy of comprehension is equivalent to that of a well-educated native

reader.

reading proficiency test - transparent language · 2018-02-23 · reading proficiency test guide...

Documents