Behavior Data Systems
Assessment Tests and Interviews Reliable Computer Graded Assessment

   

Adult Profile
The Adult Profile (AP) screens probationers for problems that are barriers to successful post-probation adjustment. When used as intake, this test enables probation officer's to know their probationers strengths and weaknesses. The Adult Profile (AP) identifies negative attitudes, violent tendencies, emotional problems, substance (alcohol and other drugs) abuse and difficulties that are barriers to successful adjustment. Early problem identification and measurement of problem severity enables probation officers to match problem severity with counseling or treatment intensity. And this increases successful outcomes.

We now know that timely and appropriate intervention directly influences treatment effectiveness. So what does the Adult Profile (AP) screen? Areas of inquiry are defined by AP scale or measures.

TEN AP SCALES

Truthfulness Scale: measures the truthfulness of the probationer was while completing the Adult Profile. This scale measures denial, problem minimization and attempts to fake good.

Self-Esteem Scale: reflects the probationer's explicit valuing and appraisal of self. This scale incorporates an attitude of acceptance-approval versus rejection-disapproval.

Antisocial Scale: measures antisocial attitudes and behavior. Its identifies probationers that are opposed to society and can be aggressive, destructive and irresponsible. High scorers are opposed to social organization and moral codes.

Anxiety Scale: measures apprehension, nervousness and somatic correlates of anxiety. Worry, fear, dread and angst are assessed.

Depression Scale: measures dejection, discouragement, melancholy and self-depreciating emotional states. Melancholy and dysphoria are assessed.

Distress Scale: measures experienced pain, worry, sorrow, stress and distress. Distress can involve both mental and physical strain. Distress can involve reasons why people seek counseling.

Family Issues Scale: measures family stability, problems and concerns. The probationers rate their own family and relationship stability.

Alcohol Scale: measures the probationer's alcohol use and if present the severity of abuse. Alcohol refers to beer, wine and other liquors.

Drugs Scale: measures drug use, and if present the severity of abuse. Drugs refer to marijuana, crack, cocaine, amphetamines, barbiturates, meth and heroin. Measures the severity of drug use and abuse.

Stress Coping Abilities Scale: measures how well the probationer copes with stress. Stress exacerbates emotional and mental health problems. A Stress Coping Abilities Scale score at or above the 90th percentile identifies the presence of an established emotional or mental health problems.

The Adult Profile (AP) provides a sound empirical basis for decision making. In addition to establishing probationer truthfulness and substance abuse involvement the AP measures important treatment recovery and relapse indications.

Many probation officers need accurate and meaningful information before referring probationers for help. The Adult Profile (AP) is an empirically based assessment instrument or test that has impressive reliability and validity. The Adult Profile (AP) helps make appropriate referrals as it identifies the nature of needed treatment along with the appropriate level of care.

Advantages of Screening
Screening or assessment instruments filter out individuals with serious problems that may require referral for substance abuse treatment or counseling. This filtering system works as follows:
AP RISK RANGES
Risk Category Risk Range Percentile Total Percentage
Low Risk 0 - 39% 39%
Medium Risk 40 - 69% 30%
Problem Risk 70 - 89% 20%
Severe Problem 90 -100% 11%

Reference to the above table shows that a "problem" is not identified until a scale score is at the 70th percentile or higher. These risk range percentiles are calculated on the probationers that have completed the AP. This procedure is fair and avoids extremes such as over-identification and under-identification of problems.

Budgetary savings (dollars) can be large with no compromises in probationers receiving appropriate evaluation and/or treatment services. Indeed, more probationers would receive help. Without a screening program, there is usually more risk of over or under-utilization of additional professional services.

AP Test Booklets
AP test booklets are provided free. These booklets contain 180 items and are written at a 5th to 6th grade reading level. If a person can read the newspaper, they can read the Adult Profile (AP).

Reports
In brief, AP reports summarize the probationer's self-report history, explain what attained scale scores mean and offer specific score-related recommendations.

Within 2 minutes of test data entry, automated (computer-scored) four-page reports are printed on-site. These reports summarize a lot of information in an easily understood format. For example, reports include a AP profile (graph), which summarizes scale scores at a glance. Also included are attained scale scores, an explanation of what each score means and specific score-related recommendations. In addition, significant items (direct admissions) are highlighted, and answers to a built-in interview (last sequence of items) are presented. Emphasis is placed on having meaningful reports that are helpful and easily understood.

To go directly to the example AP report, click on the AP Report link. EXAMPLE AP REPORT

Reliability and Validity
The AP has a proprietary built-in database that insures inclusion of all tests administered in a confidential (no names) manner. These reliability and validity statistics are reported in the document titled "AP: An Inventory of Scientific Findings." Annual database analysis further demonstrates the AP scale to have high reliability and validity coefficients.

For example, the internal consistencies (coefficient alphas) for AP scales are reported in the following table for AP assessed probationers in the year 2006. This is one among several studies.

AP RELIABILITY COEFFICIENTS (N=3,414, 2006)
AP Scales Coefficient Alpha Significance Level
Truthfulness Scale .88 p<.001
Antisocial Scale .88 p<.001
Anxiety Scale .92 p<.001
Depression Scale .89 p<.001
Self-Esteem Scale .91 p<.001
Distress Scale .90 p<.001
Family Issues Scale .88 p<.001
Alcohol Scale .93 p<.001
Drugs Scale .90 p<.001
Stress Coping Abilities Scale .94 p<.001

All AP scales are reliable. All alpha coefficients are well above the professionally accepted standard of .75. The results clearly demonstrate that the AP is a reliable test.

Early AP validation studies involved other tests that measured the same thing. These criterion group studies are reported in the document titled "AP: An Inventory of Scientific Findings." Subsequent database research further supports the validity of the AP. Moreover, in the 2006 study (N=3,414) reported above, the accuracy of the AP was demonstrated. Of the probationers involved who admitted to serious problems, the accuracy of identification is demonstrated in the following table.

An AP research study is presented at the end of this webpage. To go directly to this research, click the AP Research Study link.

AP ACCURACY (N=3,414, 2002)
AP Scales Correct Problem Identification
Alcohol Scale 100%
Antisocial Scale 100%
Drugs Scale 100%
Anxiety Scale 100%
Depression Scale 98.1%
Distress Scale 93.1%
Family Issues Scale 100%

The 70th percentile cutoff for problem identification correctly classifies nearly 100% of probationers with problems. The Low Risk level of 39% avoids putting a large number of probationers into a "moderate" range.

Undesirable outcomes associated with inappropriate treatment level placement are discussed by Andrews, Bonta and Hoge (1990). Their conclusions emphasize the importance of AP scale accuracy. By most, if not all standards, AP scales are reliable, valid and accurate.

Database
The AP system contains a proprietary built-in database. Earlier, it was noted that all used AP diskettes are returned to Behavior Data Systems, and test data is downloaded into the AP database. This expanding database allows ongoing research and testing program summary. No personal information, names, social security numbers, etc. are ever downloaded into any test database.

In summary, all returned AP diskettes' test data is centrally filed at Behavior Data Systems' offices in the AP database. This database has many advantages. Database analysis permits ongoing cost efficient research that includes scale alpha coefficients, ANOVA, frequency distributions, correlations, cross-tab statistics along with reliability, validity and accuracy determinations. Annual testing program summary provides a vehicle for program evaluation.

Annual Summary Reports
Behavior Data Systems can access each of its tests' built-in databases for statistical analysis and summarization of all tests administered in a year. Annual Summary Reports are prepared for state, department, agency and even some high volume individual providers -- at no cost to them. These reports are provided as a professional courtesy to large volume test users. Summary reports include demographics, court-history when relevant, and test statistics (reliability, validity). Has anyone offered to summarize your testing program? Annually? At no additional cost to you? Minimum testing volume for annual reports is 350 tests. There is no maximum limit. Behavior Data Systems' annual reports range in size from 800 tests to over 55,000 tests annually. An example Annual Summary Report can be viewed by clicking on this Annual Summary Report link.

Staff Member Input
The AP is to be used in conjunction with experienced staff judgment. Experienced staff should interview the probationer. For these reasons, the following statement is contained in each AP report: "Adult Profile results are confidential and should be considered a working hypothesis. No diagnosis or decision should be based solely upon these results. Use only with experienced staff judgment."

Unique AP Features
Truthfulness Scale: Identifies denial, problem minimization and faking. It is now known that many probationers attempt to minimize their problems. A Truthfulness Scale is a necessary component in contemporary tests. The AP's Truthfulness Scale has been validated with the Minnesota Multiphasic Personality Inventory (MMPI), polygraph exams, other tests, truthfulness studies and experienced staff judgment. The AP's Truthfulness Scale has been demonstrated to be reliable, valid and accurate. In some respects, the AP's Truthfulness Scale is similar to the MMPI's L and F-Scales. It consists of a number of items that most people agree or disagree with.

Truth-Corrected Scores: Have proven to be very important for assessment accuracy. This proprietary truth correction process is comparable to the MMPI's K-Scale correction. The AP's Truthfulness Scale has been correlated with the other 9 scales. The Truth Correction equation converts raw scores to Truth-Corrected scores. Truth-Corrected scores are more accurate than raw scores. Raw scores reflect what the probationer wants you to know. Truth-Corrected scores reveal what the probationer is attempting to hide.

Stress Coping Abilities Scale: Measures how well the probationer handles stress, tension and pressure. And, we now know that stress exacerbates emotional and mental health symptomatology. This scale is a non-introversive way to screen for established (diagnosable) mental health problems. A person scoring at or above the 90th percentile on the Stress Coping Abilities Scale should be referred to a certified mental health professional for a more comprehensive evaluation and diagnosis.

Three ways to give the AP. The AP can be administered in three different ways: 1. Paper-pencil test booklet format is the most popular testing procedure. AP English and Spanish test booklets and answer sheets are available. 2. Tests can be given directly on the computer screen. Some agencies dedicate computers for AP testing. And, 3. Human Voice Audio in English or Spanish is available. These three test administration modes are discussed in the "AP: Orientation and Training Manual." Each test administration mode has advantages and some limitations. Behavior Data Systems offers these three test modes so test users can select the administration mode that is optimally suited to their needs.

This test is scheduled to be added to our online testing platform, www.online-testing.com.

Reading Impaired Assessment: Reading impaired probationers represent 20+ percent of the probationers tested. This represents a serious problem to other treatment tests. Behavior Data Systems has developed an alternative for dealing with this problem: Human Voice Audio.

Human Voice Audio: Presentation of the AP is in English and Spanish. Clients' passive vocabularies are often greater than their active vocabularies. Hearing items read out loud often helps reduce cultural and communication problems. This administration mode requires earphones and simple instructions to orient the probationer to the up-down arrow keys on the computer keyboard. Human Voice Audio is an alternative approach for screening reading impaired probationers.

Confidentiality: Behavior Data Systems encourages test users to delete probationer names from diskettes before they are returned to Behavior Data Systems. Once probationer names are deleted, they are gone and cannot be retrieved. Deleting probationer names does not delete demographics or test data, which is downloaded into the AP database for subsequent analysis. This proprietary name deletion procedure involves a few keystrokes and insures probationer confidentiality and compliance with HIPAA (federal regulation 45 C.F.R. 164.501).

Test Data Input Verification: Allows the person that inputs test data from the answer sheet into the computer to verify the accuracy of their data input. In brief, test data is input twice, and any inconsistencies between the first and second data entries are highlighted until corrected. When the first and second data entries match or are the same, the staff person can continue. This proprietary Data Input Verification procedure is optional, yet strongly recommended by Behavior Data Systems.

Orientation and Training Manual: The "AP: Orientation and Training Manual" (O&T Manual) explains how the AP works. It is a must read for staff that will be using the AP. O&T Manual content includes, but is not limited to, the following: instructions for testing, an explanation of how scores are derived, a clarification of how court-related information is used, a description of unique AP features and much more.

Staff Training: Behavior Data Systems' staff is available to participate in AP training programs conducted by statewide programs, departments and high volume agencies in the United States. Sometimes, smaller volume providers get together for collective (multiple providers) on-site training. Behavior Data Systems typically participates in 4-hour or 6-hour AP training sessions. This training can include hands-on computer scoring, as desired. Behavior Data Systems gives attendees certificates attesting to their AP training.

Staff training is also provided on Fridays at Behavior Data Systems' Phoenix offices from 8:30 a.m. to 11:30 a.m. or from 1:30 p.m. to 4:30 p.m. These training sessions are free. To participate, contact Behavior Data Systems at least ten days in advance. Participation is on a first call, first scheduled basis.

Support Services: Behavior Data Systems provides a full range of support services. These services include e-mail, fax and telephone availability, provision of test-related information, telephone walk-through assistance, staff training and test consultation. Support services and test-related materials are provided free.

Test Unit Fee (Cost): AP cost information can be reviewed by clicking on the Test Unit Fee (Cost) link. There is only the one cost or charge, and that is the test unit fee. Everything else is included at no additional cost to the test user. This includes test booklets, answer sheets, training manuals, upgrades, ongoing database research, annual summary testing reports, staff training, and support services. Do not be misled by some test publishers' à la carte pricing like separate costs for each test administration as well as for each of the test-related items listed above. Instead of asking for the test administration cost, ask for the total cost involved in using a test. We believe Behavior Data Systems' one test unit fee is very affordable.

Free Examination Kit: A 1-test demonstration diskette is available on a 30-day cost free basis. Demo diskettes are in Windows format. The Examination Kit includes a 1-test demo diskette, installation CD (with instructions), test booklet, answer sheet and some descriptive materials. Behavior Data Systems, Ltd. does want the test booklet and diskette returned within 30 days.

Reference
Andrews, D., Bonta, J. & Hoge, R. (1990). Classification for effective rehabilitation: Rediscovering Psychology. Criminal Justice and Behavior 17, 19 - 52.

Selecting a Screening and Referral or Intake Test
If you are selecting a screening and referral and/or intake screening test, the following Comparison Checklist should prove helpful. It lists important screening test qualities. The "Other" column represents any other test you might want to compare to the AP.

TEST COMPARISON CHECKLIST
COMPARISON CATEGORIES AP Other
Designed Specifically for Screening and Referral Yes
A Counseling and Treatment Intake Test Yes
Test Reliability and Validity Research Provided Yes
Test Completed in 30 Minutes Yes
On-Site Reports within 2½ Minutes On-Site Yes
Truthfulness Scale to Detect Minimization and Faking Yes
Truth-Corrected Scores for Accuracy Yes
Three Test Administration Options Yes
   1. Paper-Pencil (English and Spanish) Yes
   2. On Computer Screen (English and Spanish) Yes
   3. Human Voice Audio (English and Spanish) Yes
Delete Client Names (insures confidentiality) Program Yes
HIPAA (federal regulation) Compliant Yes
Test Data Input Verification (insures accuracy) Program Yes
Available in English and Spanish Yes
Built-in Database at No Additional Cost Yes
Alcohol and Drugs Scales Yes
Anxiety Scale Yes
Distress Scale Yes
Self-Esteem Scale Yes
Family Issues Scale Yes
Depression Scale Yes
Stress Coping Abilities Scales Yes
Easily Understood Reports Yes
Facilitates Adult (male and female) Referral Yes
Annual Testing Summary Reports (Free) Yes
ASAM Compatible Recommendations Yes
Staff Training (Free) Yes
Examination Kits (Free) Yes
Thirty-Day Money Back Guarantee Yes
Very Affordable Test Unit Fee Yes

* * * *


Within 2 minutes of test data entry, automated (computer-scored) three-page reports are printed on-site. These reports summarize a lot of information in an easily understood format. For example, reports include a AP profile (graph), which summarizes scale scores at a glance. Also included are attained scale scores, an explanation of what each score means and specific score-related recommendations. In addition, significant items (direct admissions) are highlighted, and answers to a built-in interview (last sequence of items) are presented. Emphasis is placed on having meaningful reports that are helpful and easily understood.

Largely because the Adult Profile (AP) is a probation screening test, considerable space has been allocated for the evaluator's recommendations. Sometimes, assessors are influenced by information obtained from the probationer's record, in interview or from a significant "other." It is recommended that such sources of information be referenced and clarified. In other instances, the assessor may want to note their intuitions, insights or "hunches." And, it often requires space to summarize the clinical situation, probationer's motivation and recommendations. Page 4 of the AP report provides space for the evaluator's observations, conclusions and recommendations. Page 4 concludes with the probation officer's signature, date of the evaluation and a summary of the probationer's answers.

Additional information can be provided upon request by writing:
Behavior Data Systems, Ltd.
P.O. Box 44256
Phoenix, Arizona 85064-4256.

Our telephone number is (602) 234-3506
Our fax number is (602) 266-8227
and our e-mail address is bds@bdsltd.com.


Behavior Data Systems, Ltd. Copyright © 2007
ALL RIGHTS RESERVED


*****

*******************************