If you learned from my posts, inspired, or encouraged to grow in the cybersecurity and digital forensics, I would really appreciate your vote and support - Husam Shbib!
MyCyberNews
← Back to feed
AI SecurityEmerging1 sourceAug 26, 2026 · 10:00via Cisco Talos

Choose your fighter: Balancing competing requirements to select models for your AI SOC

Brief

  • Selecting a model for your security operations center (SOC) and digital forensics and incident response (DFIR) tasks is important, but selecting the best one is more involved than you might think. SOC tasks rely on a combination of model efficacy, analysis time, cost, and consistency of results.
  • Cisco Talos tested 66 model and reasoning combinations across offerings from both Anthropic and OpenAI on a log analysis task to see if we could identify a clear winner. Instead, we found a repeatable methodology that organizations can use in their own evaluations.
  • Reasoning effort was not a universal quality dial. More effort often cost more without improving the result. In some cases, more effort produced lower scores.
  • Consistency should be a major decision factor. A condition with a strong median can still produce an occasional weak run.
Read more on Cisco Talos→
AI SecurityDFIRCisco