| Implementation Guide - Quit Rate |
|
NAQC-RECOMMENDED QUALITY STANDARD: MEASURING QUIT RATES IMPLEMENTATION GUIDE Thirty-day Point Prevalence Abstinence Seven-day Point Prevalence Abstinence Critical Recommendations from the NAQC Issue Paper Conduct Follow-up
Obtain the Numerator
Report Results Interpreting Quit Rates References Calculating NAQC Standard Quit Rate Worksheet Checklist of Items to Report with Quit Rates PurposeTobacco users have access to quitlines throughout the
While the calculation of a quit rate for quitlines is relatively straightforward (the number of quitline participants who stop using tobacco divided by the number of individuals who receive quitline services), there are many ways to define both the numerator and denominator. How each is defined can have a dramatic influence on the calculation of the quit rate. The North American Quitline Consortium (NAQC) standard calculation for quit rates is designed to standardize not only the calculation of quit rates but also the definitions and measurements used to obtain both the numerator and the denominator for the quit-rate calculation. Several recent papers have provided recommendations on assessment of tobacco cessation outcomes as part of clinical trials. The goal here is to provide an easy-to-use evidence-based method to measure quitline outcomes that does not have the same degree of respondent burden and implementation cost as some of the other recommendations. This document is intended to provide a quick and user-friendly reference to key definitions, a listing of the Critical Recommendations from the full Issue Paper that is available at http://www.naquitline.org/?page=qiiissuepapers, and a calculation worksheet. Note: Quit rates are only one outcome evaluation measure, and outcome measures are only one type of evaluation that can be done.
Implementation TimelineQuitlines are encouraged to begin using the new standard definition and calculation as soon as possible. Key Definitions Consent Rate
Consent rate is the proportion of callers who agree to be contacted for evaluation purposes. Example: 100 people are asked at intake if they will agree to be called in 7 months to be asked about their experience with the quitline and with quitting. If 96 people say "yes,” the consent rate is 96%. Quitlines may vary in terms of the population that is asked to provide consent for follow-up; some may ask all callers to consent for follow-up, while others may only ask those who register for a multiple-call proactive counseling program. NAQC recommends including the population that was asked to provide consent along with the consent rate. Response Rate
Response rate is the number of people who complete a survey divided by the number of people the evaluator attempted to reach to complete the survey. Example: 100 people are selected to be followed up at 7 months; 60 of them complete the survey. The response rate is 60%. Seven-month Follow-up
Quitlines should strive to have the average time to follow-up be as close to the 7-month mark as possible. One strategy for this is to begin the follow-up window 2 weeks before the 7-month anniversary mark and end it 2 weeks after the 7-month anniversary mark (rather than to start making calls at the 7-month anniversary mark). NAQC recommends that quitlines report the average time to follow-up and the range of time to follow-up with the quit rate. Point Prevalence Abstinence
Point prevalence abstinence is a method of measuring whether someone has stopped using a substance (in this case, tobacco) at a given point in time (in this case, 7 months after registering for services). In point prevalence abstinence measures, the interval for measuring the use of the substance in question is often shorter than in long-term abstinence measures. Shorter term measures like point prevalence abstinence are recommended because - there is a high degree of correlation between point prevalence and continuous abstinence measures, - more published studies use point prevalence measures, and - continuous abstinence measures often result in an underestimate of the true quit rate, given that many people relapse or slip in their quit attempts but then go on to achieve a successful quit. Thirty-day Point Prevalence Abstinence
Thirty-day point prevalence abstinence is a measure of, in this case, tobacco cessation outcomes for quitlines. At a given point in time (in this case, 7 months after program registration), quitline participants are asked whether they have used cigarettes or other forms of tobacco in the past 30 days. Those who reply that they have not used tobacco in the past 30 days are considered to have quit. Thirty-day point prevalence abstinence is measured with the Minimal Data Set (MDS) follow-up question: "Have you used any [INSERT TOBACCO TYPE], even a puff or pinch, in the last 30 days?” NAQC recommends 30-day point prevalence abstinence as the primary measure for reporting on quitline outcomes (See Reporting Checklist below). Seven-day Point Prevalence Abstinence
Seven-day point prevalence abstinence is a measure of, in this case, tobacco cessation outcomes for quitlines. At a given point in time (in this case, 7 months after program registration), quitline participants are asked whether they have used cigarettes or other forms of tobacco in the past 7 days. Those who reply that they have not used tobacco in the past 7 days are considered to have quit. Seven-day point prevalence abstinence is measured with the optional MDS follow-up question "Have you used any [INSERT TOBACCO TYPE], even a puff or pinch, in the last 7 days?” While 7-day point prevalence abstinence is not recommended by Responder Rate
The responder rate (RR) is a measure of quit rate in which the numerator is all respondents who report having quit using tobacco and the denominator is all those who responded to the survey. Example: If 100 people were in the sample for follow-up, 60 completed the survey, and 18 reported having quit using tobacco, the responder rate is 18 divided by 60, or 30%. The RR calculation produces a more optimistic quit-rate estimate for all quitline participants than the intention-to-treat (ITT) rate (see below). Intention-to-treat Rate
The ITT quit rate is a measure of quit rate in which the numerator is all respondents who report having quit using tobacco and the denominator is all those in the follow-up sample, regardless of whether or not they completed the survey. All those who did not complete the survey (or who did not answer the question about quit status) are assumed to be still using tobacco. Example: If 100 people were in the sample for follow-up, 60 completed the survey, and 18 reported having quit using tobacco, the intention-to-treat quit rate is 18 divided by 100, or 18%. The ITT calculation produces a more conservative estimate of the quit rate for all quitline participants. Evidence-based Treatment
For the purposes of calculating quit rates for quitlines, evidence-based services include the provision of any amount of counseling or medications. Even a small amount of counseling has been shown to be effective in a clinical setting. While a clinical setting is not identical to a quitline setting, it is reasonable to assume that the same types of relationships exist between length of total contact time and outcomes for quitlines as for counseling in a clinical setting. The 2008 Clinical Practice Guideline divides counseling into several categories based on total amount of person-to-person contact time in a clinical setting, from 1-3 minutes to more than 300 minutes (Fiore et al., 2009). (See Table 6.9 on page 85 of the Guideline for details.) While any contact time significantly increased abstinence rates over those produced by no contact, there was a clear correlation between increased contact time and higher abstinence rates up to 90 minutes. There was no evidence that abstinence rates continued to increase beyond 90 minutes of total contact time (Fiore et al., 2009). For quitlines, time spent conducting intake or other assessment procedures should not be included in the calculation of the number of minutes of counseling. If quitlines cannot identify exactly when counseling starts, they should identify an average number of minutes for noncounseling activities (e.g., intake, assessment), and subtract that from the total number of minutes of interaction to obtain the number of minutes of counseling. Estimates are fine, especially if identifying an exact number would be burdensome for a quitline. While it is not critical to be able to identify the exact number of minutes of counseling each caller received, quitlines are encouraged to consider how the total number of counseling minutes provided fits into their goals and available resources. Quitlines may want to examine the relationship between quit rates and total number of minutes of counseling in order to help answer the question of whether the differences in efficacy found in the literature for clinical settings also hold for telephone quitlines. Medications counted as evidence-based treatment include nicotine replacement therapy (NRT), bupropion, and varenicline. As new treatments amass sufficient proof of their efficacy, the list of evidence-based treatments will grow. For example, while the evidence base for Web-based services is still developing, a recent meta-analysis concluded that there is sufficient clinical evidence to support the use of Web- and computer-based smoking cessation programs for adult smokers (Myung, 2009). Additional research is needed, especially to determine what elements of Web-based services are necessary to be effective. Sampling
Choosing to conduct a 7-month follow-up survey with every eligible quitline participant can be costly. Yet it is critical that those surveyed for a quit-rate study represent the whole group of eligible participants fairly. One way to both contain the costs of an evaluation and to survey a representative group of program participants is random sampling: the process of systematically selecting a subset of participants to be included in a quit-rate evaluation. A random sample is based on the principle that each subject selected to participate has an equal probability of being included in the study. Random sampling may be conducted on an ongoing or rolling basis. NAQC considers this to be the optimal sampling strategy because seasonal variation can be controlled for and changes in protocol can be assessed. Other sampling strategies may also be employed, including single or multiple time-limited (cohort) sampling, and may meet the needs of individual quitlines. See the Critical Recommendations on Conducting Follow-up for more details. Survey Mode
Survey mode refers to the method by which survey data is gathered. Common modes include telephone, mail, and Internet options, or some combination of the three. For quitlines, follow-up data collection by telephone may make the most sense because quitline services are also provided by telephone, and potential respondents may be more inclined to provide information in this format. However, telephone surveys can be expensive, and some combination of survey modes (e.g., mail or Internet surveys followed by telephone follow-up with nonresponders) may also work well and may reduce evaluation costs. Multiple modes may also help to increase response rates to or above the NAQC-recommended minimum of 50%. When using multiple modes, quitlines will need to consider the administrative costs of tracking multiple modes as well as logistical details, such as translating skip patterns appropriately to a paper or Internet-based survey. Critical Recommendations from the
|
|
|
Data source |
Notes |
Calculations |
|
Step 1. Select all callers. |
Quitline records |
Includes all those calling for themselves or others. Does not need to be de-duplicated at this point. |
|
|
Step 2. Exclude prank calls, hang-ups, wrong numbers, etc. |
Quitline records |
|
|
|
Step 3. Exclude proxy callers. |
MDS item: "Just to confirm, are you calling for yourself, or on behalf of or to help someone else?” |
Those calling on behalf of or to help someone else should be excluded. |
|
|
Step 4. Exclude all nontobacco users. |
MDS intake items: "When was the last time you [USED TYPE OF TOBACCO] even a puff [or pinch]?” |
Anyone whose date of last tobacco use was within 30 days of first contact with the quitline should be included in the quit-rate calculation. If the date of last use for ALL types of tobacco was more than 30 days prior to first contact with the quitline, they should be excluded from the quit-rate calculation. |
|
|
Step 5. Exclude all those who did not consent to follow-up. |
Quitline records |
Each quitline will have its own requirements for and methods of requesting consent for follow-up. If a caller declines to give consent for follow-up, they should not be followed up and should not be included in the quit-rate calculation. |
|
|
Step 6. Exclude all those who did not receive treatment. |
MDS Intake administrative data on service provided, or other quitline tracking information |
Receipt of evidence-based treatment includes all those who started counseling and received any number of minutes of counseling (not including time for intake or assessment) AND/OR received quitting medications (NRT, bupriopion, or varenicline) through the quitline. |
|
|
Step 7. De-duplicate list. |
Quitline records |
Make sure each individual is calling only once. The de-duplication process can be done at any point. |
|
|
Step 8. Select a sample for follow-up survey. |
Select sample from the total population identified in step 7 above |
Recommend rolling sample of randomly selected participants, if possible. (See the Critical Recommendations on Conducting Follow-up for alternative sampling strategies.) |
N= |
|
Follow-up survey results |
Follow-up should be conducted 7 months following quitline enrollment (or date of first contact). Enter number of completed surveys in box at right. |
N= | |
|
Step 10. Obtain a response rate. |
Follow-up survey results—strive to have at least 50% complete the survey. |
The number of participants who completed a follow-up survey (and provided a response to the quit-status question) divided by the number in the sample |
Divide total on line 9 by total on line 8 above = % |
|
Step 11. Assess quit status of respondents. |
MDS follow-up item: "Have you smoked any cigarettes or used other tobacco, even a puff or pinch, in the last 30 days?” |
Enter the number of respondents who reply "no” to the MDS question at left in the box at right. |
N= |
|
Step 12. Calculate |
Responder rate using 30-day point prevalence measure |
Divide the number in step 11 (those replying "no” to the question "Have you smoked any cigarettes or used other tobacco, even a puff or pinch, in the last 30 days?”) by the total number of respondents in step 9. |
Quit rate = % |
¨ 30-day point prevalence abstinence rate (responder rate), calculated at 7 months after intake/registration/first contact. (See the worksheet above for step-by-step instructions.)
¨ Confidence intervals
¨ Consent rate and description of population asked to provide consent
¨ Total N in the follow-up sample
¨ Total n of respondents
¨ Response rate
¨ Average and range of time to follow-up
¨ Who conducted the evaluation (e.g., internal or external to the quitline)
¨ Description of the program
- Type of protocol (single vs. multiple call protocol, proactive vs. reactive)
- Number of calls indicated by the protocol and average number of calls completed
- Optional: Average number of total (cumulative) minutes of counseling
- Duration of program (e.g., typically five calls over a 2-month period; reactive support for up to 12 months)
- Special counseling strategies, protocols and content (if any)
- NRT or other medications provided (types and amounts)
- If reporting a single quit rate for all types of programs and protocols together, provide proportions of people served by each program.
- Quitlines may also want to consider calculating quit rates for each category of counseling intensity actually received (minimal, low, higher), for different categories of number of calls completed, or for combinations of counseling intensity, number of calls, number of minutes and medication use.
¨ Eligibility criteria for the program
¨ Demographics of callers for each program or group of programs included in the quit-rate calculation. (Use MDS items where applicable.)
- Gender (percentage male and percentage female)
- Age (mean, median, minimum, maximum)
- Ethnicity (in the
- Race (percentage reporting each major race and ethnicity category as listed in the MDS for
- Insurance status (in the
¨ Tobacco use characteristics of callers for each program or group of programs included in the quit-rate calculation
- Every day and daily tobacco users vs. some day and occasional tobacco users vs. not-at-all tobacco users ("not-at-all” tobacco users would include only those who have quit within the past 30 days)
- Cigarettes per day (percentage of callers falling into light, moderate, and heavy categories)
- Time to first cigarette (percentage reporting in each category as listed in the MDS)
Readiness to quit (percentage reporting in each category as listed in the MDS)16 hours agoHoliday Greetings and Every Success in the Year Ahead
12/11/2025NAQC Community Highlights - December 2025 Issue
12/9/2025 NAQC Abstract Deadline Approaching!
The upcoming calendar is currently empty.