policybazaar.ai assistant

policybazaar.ai team · Chat · In-house

Live

Today

91%

replayed, no recorded replies in this run

Best passing

Policybazaar Flash + Pro (open models)

100% · $0.0012 per reply

Models tested

3

31 gold calls · 36 replies each

Run cost

$1.26

Quality against cost

70%80%90%100%cheaper, no worsecheaper, no worse$0.001$0.01$0.1Per replygemini-2.5-flash · today: Quality 91%, $0.0090 per replyPolicybazaar Flash + Pro (open models): Quality 100%, $0.0012 per reply, Can switchGemini 3.1 Pro, every turn: Quality 100%, $0.0248 per reply, Too slowgemini-2.5-flash · todayGemini 3.1 Pro, every turn
Models · highest first
ModelReplay qualityDecisionMust-pass breaksPer replyQualityMust-passEvery topicSpeedCost
100%Can switch0$0.0012✓✓✓✓✓
100%Too slow0$0.0248✓✓✓✕✕
gemini-2.5-flash · today91%––$0.0090✓✕✓✕✓
Replies worse than today · gemini-2.5-flash · today · first 6 of 0
CallBroken checkReply
a1
turn 4
C02
asked: "Note kar liya. Aap ki age kya hai?"
Note kar liya. Aap ki age kya hai?
a4
turn 7
C02
reply: "Theek hai, main aapki car insurance ki journey shuru kar raha hoon."
Theek hai, main aapki car insurance ki journey shuru kar raha hoon.
a5
turn 2
C02
state not as expected
Theek hai, aapke papa (64) aur mummy (59) ke liye health cover save kar liya hai.
g4
turn 3
C03
reply: "Ji, abhi hum quotes nahi dikha pa rahe hain. Kripya pehle confirm kijiye ki aapko kiske liye cover chahiye."
Ji, abhi hum quotes nahi dikha pa rahe hain. Kripya pehle confirm kijiye ki aapko kiske liye cover chahiye.
t1
turn 3
C04
state not as expected
Engine protect ke saath aapko kaunsa plan chahiye, Insurer C, Insurer D ya Insurer E? Main aapko unki details bata deta hoon.
t2
turn 4
C04
state not as expected; state not as expected
The plans main aapko WhatsApp par bhej deta hoon. Iske liye aapko login karna hoga.
Score by topic · gemini-2.5-flash · today against today · topics with 5+ replies
TopicRepliesTodaygemini-2.5-flash · today
Car insurance292%92%
Health insurance2188%88%
Investment plans1100%100%
Policy service1100%100%
Term insurance1100%100%
Two-wheeler insurance598%98%