AI safety tools trained on data from some neighborhoods or demographics will inevitably rank risks and recommend preparations differently for families that aren't represented in that training data. If the system learned threat patterns from affluent urban areas, it might underestimate dangers in rural regions or over-emphasize middle-class specific scenarios.
Algorithmic bias happens when AI is trained on data that doesn't represent everyone equally, so it makes recommendations that work for some people but miss others entirely. Think of it like a fire safety course designed by people who all have perfect vision and mobility—the advice would miss dangers that blind or wheelchair-using people face.
In emergency planning, bias can be dangerous because AI might recommend strategies that don't actually work for your family, and you might follow advice that leaves your household more vulnerable, not less.
AI systems learn from historical emergency data and expert advice. But that data reflects whose emergencies were recorded, whose voices were listened to, and whose situations were considered "normal." Some common biases:
A biased AI might tell a family with a non-verbal child to "communicate your location to emergency responders." It might recommend a family with limited income to "stock a 3-month supply of non-perishable food." It might suggest a single-parent household divide responsibilities among multiple adults. Sound advice for some families, completely useless or harmful for others.
When AI doesn't account for your family's reality, the emergency plan itself becomes a liability rather than protection.
When AI gives you safety advice, ask: "Does this actually work for my family's specific situation?" Look for recommendations that:
If you notice bias, tell AI: "This advice assumes X, but our family is Y. How would this plan change?" Good AI systems can adapt when you point out how their recommendations miss your reality.
Try this: Ask an AI for a basic emergency plan recommendation. Then challenge it: "How would this change for a family with a deaf parent who needs a visual alert system?" or "What if we don't own a car?" or "Our family speaks Spanish at home." Notice where the initial advice didn't account for diversity. This is bias. Good AI should be able to adjust when you point it out.
Peri can explain this concept, give practical examples, help you decide whether it applies to your situation, or recommend a journey if appropriate.
Explore related journeys or tell Peri what you're working through.