Learning goals

I can identify methodological differences, hidden assumptions, evidential limits, and genuine contradictions across specialised sources.
I can produce a critical synthesis organised by issues rather than source order and preserve material uncertainty.
I can make conflicting evidence accessible to decision-makers without flattening differences or manufacturing consensus.

What you will be able to do

I can identify methodological differences, hidden assumptions, evidential limits, and genuine contradictions across specialised sources.
Skill
reception
I can produce a critical synthesis organised by issues rather than source order and preserve material uncertainty.
Skill
production
I can answer challenges to source choice, weighting, and interpretation with precision and openness to revision.
Skill
interaction
I can make conflicting evidence accessible to decision-makers without flattening differences or manufacturing consensus.
Skill
mediation
I can decide what to omit, define, exemplify, or qualify for the target audience.
Skill
strategies
I can recognise that sources may use different institutional or cultural frames while applying transparent evaluation criteria.
Skill
pluricultural competence

Core vocabulary

an operational definition

The rule used to decide what is counted or measured.

An operational definition of success must identify what a completed transaction includes.

selection effects

Differences produced by who enters an observation or sample.

Selection effects may explain why confident users dominate the feedback forms.

a competing explanation

Another account that could explain the observed pattern.

A quieter month is a competing explanation for the shorter desk queue.

not directly comparable

Measured in ways that prevent a simple like-for-like comparison.

The two success rates are not directly comparable because their denominators differ.

to disaggregate

Separating a total to examine meaningful categories.

We need to disaggregate completed loans from attempts requiring assistance.

a convergence of evidence

Different observations supporting a related interpretation.

There is a convergence of evidence about queue relocation, not necessarily about total time saved.

an evidential gap

A missing observation needed to support an inference.

Unrecorded abandoned attempts leave an evidential gap in the efficiency claim.

to weight a source

Assigning influence according to relevance and quality rather than preference.

Weight a source for the question it can answer, not for the conclusion you prefer.

a conditional recommendation

Advice whose force depends on stated evidence or circumstances.

A conditional recommendation identifies what would justify expansion and what would stop it.

residual uncertainty

Doubt that remains after available evidence has been considered.

The brief should name residual uncertainty rather than manufacture agreement.

Meaning through delivery

Use clear contrastive stress when switching denominators or source definitions. Pause before a caveat that changes the interpretation of a percentage.

An operational definition of success must identify what a completed transaction includes.
Selection effects may explain why confident users dominate the feedback forms.
A quieter month is a competing explanation for the shorter desk queue.
The two success rates are not directly comparable because their denominators differ.
We need to disaggregate completed loans from attempts requiring assistance.
There is a convergence of evidence about queue relocation, not necessarily about total time saved.
Unrecorded abandoned attempts leave an evidential gap in the efficiency claim.
Weight a source for the question it can answer, not for the conclusion you prefer.
A conditional recommendation identifies what would justify expansion and what would stop it.
The brief should name residual uncertainty rather than manufacture agreement.

Extended listening · Five reports disagree about a library self-service trial

First listen for the situation and stance. Then record details, inference and uncertainty separately. Attempt the questions before revealing the transcript.

Why must the several eighty-per-cent figures not be combined?
What distinguishes forty-eight from sixty per cent in S2?
What is missing from the queue-effect claim?
Why is the six-person review still useful?

Listening notes

Transcript

Five documents contain several figures close to eighty per cent. It is tempting to combine them into a single reassuring story: eighty per cent completion, eighty per cent positive feedback, and a broadly successful trial. That story confuses outcomes and populations. The terminal export counts sessions with at least one completed issue. The feedback summary counts voluntary respondents who selected convenient. Neither number tells us directly how many people completed a loan independently.

The staff observation makes the distinction visible. There were one hundred and fifty observed sessions. One hundred and twenty completed, and forty-eight of those completed sessions involved assistance. That leaves seventy-two unassisted completions. Seventy-two out of one hundred and fifty is forty-eight per cent of all observed sessions. Seventy-two out of one hundred and twenty is sixty per cent of completed sessions. A disagreement between forty-eight and sixty may therefore be a denominator difference rather than an arithmetic error.

The queue report raises another issue. A median desk wait fell from six minutes to four while desk arrivals also fell and a nearby teaching building was closed for a week. There may be a useful effect, but the comparison does not isolate it. Nor does it measure the unrecorded queue at the terminal. We cannot turn a change in one visible queue into a verified improvement in the entire user journey.

Finally, the small accessibility review should not be discarded merely because it contains six invited users. It is not designed to estimate prevalence. It identifies barriers that a larger transaction total cannot describe. Weighting evidence means asking which question a source can answer and how securely, not letting the largest number settle every question.

For your synthesis, organise the argument around independence, experience, workload and access rather than taking one source at a time. State where sources converge, where they use different definitions and where a genuine tension remains. Your decision brief must identify what would justify expansion, what would require revision and what remains unmeasured. In the colloquium, be prepared to revise a source weighting without abandoning the transparent criteria that produced it.

Reading and source dossier

Read all source cards. Track authorship, purpose, definitions and limitations. Cite source and paragraph IDs in the answers. All sources are fictional practice material.

All source people, organisations, figures and quotations in this pack are invented for learning.

S1 · Machine transaction export

Library systems analyst

Invented for this course. Not a real organisation, study, quotation or public announcement. Cite the source ID within this exercise only.

[1] During the four-week trial, the self-service terminal recorded 1,200 sessions. A session began when a user touched the start screen and ended when the terminal returned to its home screen. The export classifies 960 sessions as completed because at least one item was successfully issued. The remaining 240 sessions contain no completed issue. This produces an eighty per cent session-completion rate under the terminal's definition.

[2] The system does not record whether a completed session required a staff member to intervene. It also does not count a person who approached the terminal, read the screen and walked away without touching start. A user can open several sessions on the same visit, and a completed session can contain more than one item. Sessions are therefore not equivalent to people, visits, items or independent attempts to borrow a specific book.

[3] A software update on the second Monday shortened the automatic timeout from ninety seconds to forty-five. A person who paused to read instructions after the update could generate two sessions while doing what would previously have appeared as one. The analyst retained both periods in the export but cautions against treating every week as operationally identical. No claim about total staff time or user satisfaction can be drawn from this export alone. It supports a narrower statement: 960 of the recorded sessions included at least one completed issue under the logging rules in force at the time.

S2 · Staff observation sample

Service desk supervisor

Invented for this course. Not a real organisation, study, quotation or public announcement. Cite the source ID within this exercise only.

[1] Staff observed the terminal during twelve preselected half-hour periods spread across weekdays and evenings. They counted 150 terminal sessions, using the same visible start-to-home sequence as the system. Of these, 120 included a completed issue. Staff assisted during 48 of the 120 completed sessions and during 18 of the 30 non-completed sessions. Assistance ranged from a brief verbal cue to taking over the process. No common duration measure was used.

[2] The sample's eighty per cent completion rate resembles the machine export, but this agreement does not show that eighty per cent of sessions were independent. In the observed sample, 72 of 150 sessions completed without recorded assistance: forty-eight per cent of all observed sessions. Alternatively, 72 of the 120 completed sessions were unassisted: sixty per cent of completed sessions. Either percentage can be accurate when its denominator is stated; they answer different questions.

[3] The observation windows were selected to include times when a trained supervisor was present. They are not a random sample of every operating hour. Staff could also have changed their behaviour because observation was occurring. The supervisor recommends a follow-up that measures assistance time consistently and samples quieter periods as well as predictable peaks. Until then, the notes should challenge an independence claim but should not be inflated into an exact estimate of total weekly support workload.

S3 · Queue comparison note

Operations planning officer

Invented for this course. Not a real organisation, study, quotation or public announcement. Cite the source ID within this exercise only.

[1] The median wait at the staffed desk was six minutes during the month before the trial and four minutes during the trial month. Counts taken by the same method show 900 arrivals at the desk in the earlier month and 720 in the later month. The trial therefore coincided with both a shorter median desk wait and fewer recorded desk arrivals. The comparison does not track the same users or their total time from entering the library to completing a loan.

[2] The trial month also contained a one-week closure of a nearby teaching building. Library entry counts fell during that week. This is a plausible competing explanation for at least part of the reduced desk demand. In addition, staff informally reported a queue near the terminal, but those waits were not timed. It is possible that some waiting moved rather than disappeared. The present data cannot quantify that movement.

[3] The officer advises against the sentence, Self-service cut waiting time by one third. A reduction from six to four minutes in one observed median is real in the records, but attributing it entirely to the terminal adds a causal claim. Calling it a one-third improvement in the whole borrowing experience also expands the outcome. A defensible summary identifies the staffed-desk measure, the comparison periods and the missing terminal-wait data. A future design should record the full user journey rather than optimise the visibility of one queue.

S4 · Voluntary user feedback summary

User experience facilitator

Invented for this course. Not a real organisation, study, quotation or public announcement. Cite the source ID within this exercise only.

[1] Ninety feedback forms were submitted after terminal use. Seventy-two respondents selected convenient, twelve selected neither convenient nor inconvenient, and six selected inconvenient. The form offered no category for someone who did not attempt the terminal. Eighty per cent of these responses were positive under that wording, but the response count cannot be treated as a representative sample of all library users.

[2] The collection method may have favoured people who completed a session and noticed the invitation screen. It did not record whether a respondent had received assistance. A positive answer can therefore coexist with dependence on staff support. That is not a contradiction: a supported interaction may genuinely feel convenient. The research question is whether convenience, independence, accessibility and workload are being distinguished rather than forced into one success label.

[3] Open comments reveal incompatible preferences. Some respondents wanted fewer prompts; others valued the step-by-step prompts and asked for clearer explanations. The summary should not call this disagreement noise. It indicates that a single interface may need more than one route through the task. These comments can guide questions for a pilot, but their frequency in this small voluntary set does not establish how common each preference is in the wider population. The facilitator recommends testing changes with people who currently avoid the terminal, not only those who already use it confidently.

S5 · Accessibility and investment review

Joint review panel

Invented for this course. Not a real organisation, study, quotation or public announcement. Cite the source ID within this exercise only.

[1] The panel observed six invited users completing the borrowing task with the terminal. Two used a seated position, two used magnification and two requested instructions in a language other than the interface default. These descriptions identify test conditions, not a representative distribution of user needs. Four participants completed the task with some assistance; two did not complete it during the allotted session. The panel did not calculate a general population success rate from six cases.

[2] The cases identified specific barriers: instructions disappearing after a timeout, an important button outside the initial magnified view, and an error message that did not explain a recoverable next action. These are actionable findings even though the group is too small and deliberately selected to estimate prevalence. Dismissing them because the transaction export is larger would confuse different kinds of evidence. Conversely, treating every user as certain to encounter all three barriers would overgeneralise from the cases.

[3] The panel recommends retaining the staffed route, correcting the identified barriers and running a second trial with agreed success definitions. Expansion should depend on evidence about independent completion, assisted completion, abandonment, total journey time and the experience of users previously excluded from feedback. The recommendation is conditional, not a declaration that the terminal succeeded or failed overall. A funding decision also involves the value placed on access and service quality; those priorities should be stated openly rather than hidden inside an apparently neutral aggregate percentage.

Reading questions

How did the software update affect comparability within S1?
How many observed completed sessions were unassisted?
Can positive convenience feedback coexist with staff assistance?
What conditions does S5 attach to expansion?

Language in use

Grammar and reformulation

Title

Issue-led synthesis, aligned denominators, attribution, methodological concessions and conditional recommendations.

Examples

An operational definition of success must identify what a completed transaction includes.
Selection effects may explain why confident users dominate the feedback forms.
A quieter month is a competing explanation for the shorter desk queue.
The two success rates are not directly comparable because their denominators differ.

Local and daily-life application

Term
an operational definition
Thai
นิยามที่ใช้วัดจริง
Pronunciation
ɐn ˌɑːpɚɹˈeɪʃənəl dˌɛfɪnˈɪʃən
Example
An operational definition of success must identify what a completed transaction includes.
Term
selection effects
Thai
ผลจากการคัดเลือกกลุ่มตัวอย่าง
Pronunciation
sɪlˈɛkʃən ɪfˈɛkts
Example
Selection effects may explain why confident users dominate the feedback forms.
Term
a competing explanation
Thai
คำอธิบายทางเลือกที่เป็นคู่แข่ง
Pronunciation
ɐ kəmpˈiːɾɪŋ ɛksplɐnˈeɪʃən
Example
A quieter month is a competing explanation for the shorter desk queue.
Term
not directly comparable
Thai
เปรียบเทียบกันโดยตรงไม่ได้
Pronunciation
nˌɑːt dɚɹˈɛktli kˈɑːmpɚɹəbəl
Example
The two success rates are not directly comparable because their denominators differ.

Place
Source workshop
An operational definition of success must identify what a completed transaction includes.
Pronunciation
ɐn ˌɑːpɚɹˈeɪʃənəl dˌɛfɪnˈɪʃən ʌv səksˈɛs mˈʌst aɪdˈɛntᵻfˌaɪ wʌt ɐ kəmplˈiːɾᵻd tɹænsˈækʃən ɪnklˈuːdz.
Tip
The rule used to decide what is counted or measured.
Place
Source workshop
Selection effects may explain why confident users dominate the feedback forms.
Pronunciation
sɪlˈɛkʃən ɪfˈɛkts mˈeɪ ɛksplˈeɪn wˌaɪ kˈɑːnfɪdənt jˈuːzɚz dˈɑːmᵻnˌeɪt ðə fˈiːdbæk fˈɔːɹmz.
Tip
Differences produced by who enters an observation or sample.
Place
Source workshop
A quieter month is a competing explanation for the shorter desk queue.
Pronunciation
ɐ kwˈaɪəɾɚ mˈʌnθ ɪz ɐ kəmpˈiːɾɪŋ ɛksplɐnˈeɪʃən fɚðə ʃˈɔːɹɾɚ dˈɛsk kjˈuː.
Tip
Another account that could explain the observed pattern.

Independent practice

Trace each material claim to a source ID and paragraph.
Complete the required performance task; keep the first attempt.
Review using the analytic criteria, revise and explain one important change.

Interaction model

Participant A

The largest source says eighty per cent succeeded, so why give the six-person review much weight?

Participant B

Because the export counts completed sessions, while the review investigates barriers. Size does not make them answer the same question.

Participant A

But the observation sample also reports eighty per cent completion.

Participant B

Yes, and it distinguishes assisted from unassisted completion. That qualifies the independence claim rather than contradicting the transaction count.

Participant A

What would make you change your recommendation?

Participant B

Consistent evidence about the complete user journey, fewer avoidable barriers, and a clear account of staff support under an agreed definition of success.

Synthesis studio

Organise by issues, not by source order. Distinguish genuine contradictions from differences in scope, population, purpose or definition. Analyse all five dense sources. Produce a 1,400–1,700-word issue-led critical synthesis, a two-page decision brief, a source-weighting matrix and an oral defence of two judgements. Preserve differences in populations, definitions and methods; do not average unlike percentages or manufacture consensus.

Output

Analyse all five dense sources. Produce a 1,400–1,700-word issue-led critical synthesis, a two-page decision brief, a source-weighting matrix and an oral defence of two judgements. Preserve differences in populations, definitions and methods; do not average unlike percentages or manufacture consensus.

Citation policy

Use [S1-P1] style local references. These invented sources must never be represented as external research. Clearly identify any permitted external source and its permission separately.

Your notes

Write, review, revise

Target words min

1400

Target words max

1700

Checklist

State the decision, audience and claim boundaries.
Trace factual claims and distinguish source evidence from interpretation.
Address the strongest relevant alternative fairly.
Revise a material weakness and explain the change.

Drafts

argument plan
first draft
peer feedback
revised final version

Revision focus

argument and inference
global structure
evidence and attribution
style and reader usability

Feedback cycle

Self-check → peer feedback → revise and explain your changes.

Your notes

Unrehearsed interaction

Read your role card separately. Make a bounded proposal, respond to an unexpected challenge, check one interpretation and seek a precise next step. Keep the disagreement visible when it remains unresolved.

Scenario

Five reports disagree about a library self-service trial

Roles

Role
Evidence presenter
Brief
Explain the most defensible proposal from the dossier. State one limit you will not conceal.
Constraint
Do not invent an observation to close a gap.
Role
Critical reviewer
Brief
Choose a material definition, alternative explanation or source limitation and challenge the proposal.
Constraint
Acknowledge one valid part of the opposing case before challenging an inference.
Role
Recipient and mediator
Brief
Ask what the proposed action means for someone who has not read the sources. Test whether all participants attach the same meaning to a key term.
Constraint
Do not decide what someone intended without checking.
Role
Observer
Brief
Record exact moments of clarification, qualification, repair and recipient understanding.
Constraint
Assess the observed move, not confidence, accent identity or personality.

Goals

I can answer challenges to source choice, weighting, and interpretation with precision and openness to revision.
I can make conflicting evidence accessible to decision-makers without flattening differences or manufacturing consensus.

Negotiation moves

Acknowledge a supported point.
Name the particular inference you question.
Request a targeted clarification.
Offer a conditional next step.
Read back a shared understanding without forcing agreement.

Duration seconds

720

Your notes

Audience and pragmatic effect

Reformulate one important claim for a specialist colleague, a new participant and a decision-maker. Test the received effect and preserve the factual boundary.

Contexts

specialist peer review
new participant orientation
decision briefing

Target functions

qualify a claim
request clarification
disagree diplomatically
repair an unintended implication

formal and explicit
neutral and action-oriented
collegial but bounded

Repair

Ask what the recipient understood, acknowledge the effect, clarify the intended proposition, and test the revised wording.

Your notes

Make the evidence usable

Brief a recipient who has not read the dossier. Preserve critical qualifications, explain one difficult concept, invite a check-back and revise the explanation if the recipient misunderstands. Two-page decision brief with evidence-strength labels.

Source en

Five reports disagree about a library self-service trial — Use the identified sources, not memory or invented facts.

Mode

text-concepts-and-communication

Audience

A peer decision group unfamiliar with this dossier; later repeat for a specialist reader.

Source ids

esl6-w05-S1
esl6-w05-S2
esl6-w05-S3
esl6-w05-S4
esl6-w05-S5

Constraints

Do not invent missing results or permissions.
Retain material uncertainty and disagreement.
Ask recipients to state a decision and what remains uncertain.
Do not speak for a cultural group or infer private motives.

Your notes

Timed speaking and defence

Prompt

Preparation seconds

120

Speaking seconds

300

Follow up

Which source most strongly supports your central claim, and why?
Which limitation would materially change your proposed action?
A recipient has misunderstood one condition. Reformulate it without adding a new promise.

Your notes

Spoken task prompts

I can answer challenges to source choice, weighting, and interpretation with precision and openness to revision.

I can make conflicting evidence accessible to decision-makers without flattening differences or manufacturing consensus.

Speaking secondsReady

◆ Critical synthesis of dense and conflicting sources

Learning goals

Core vocabulary

an operational definition

selection effects

a competing explanation

not directly comparable

to disaggregate

a convergence of evidence

an evidential gap

to weight a source

a conditional recommendation

residual uncertainty

Meaning through delivery

Extended listening · Five reports disagree about a library self-service trial

Transcript

Reading and source dossier

S1 · Machine transaction export

S2 · Staff observation sample

S3 · Queue comparison note

S4 · Voluntary user feedback summary

S5 · Accessibility and investment review

Reading questions

Language in use

Interaction model

Synthesis studio

Write, review, revise

Unrehearsed interaction

Audience and pragmatic effect

Make the evidence usable

Timed speaking and defence

Spoken task prompts

Support and access

My portfolio

Check your interpretation