Error Correction Example
Entity Agent's Disposable Node design means multiple AI models can be used to solve a problem easily.
Below we demonstrate how 2 models (llama vision from Meta USA and paddleocr from Baidu China) can work together to solve an Australian problem.
1. Coles Receipt
Supermarket receipts are normally ofr poor quality and the above receipt has been foldered and sat on a desk near for about a week so some parts have faded.
1.1. llama vision
Below is the JSON output extracted using the llama vision model which is a large language model with combined text and image capability.
Since llama is a default model we have available worldwide, it is normally used first, if needed more specialised models can be used afterwards.
{
"companyName": "Coles Supermarkets Australia Pty Ltd",
"abn": "45 004 189 708",
"companyAddress": "Store: 853 - CS BONDI WESTFIELD",
"manager": "Justin",
"telephone": "02 8383 4800",
"servedby": "Pinky",
"register": "007",
"receipt": "96",
"date": "09/03/2025",
"time": "12:42",
"currency": "$",
"items": [
{
"name": "% SORBENT TOILET TSS 24PACK",
"quantity": 1,
"price": 13,
"each": "$13.00"
},
{
"name": "ANGAS PARK PITTED PR 1KG",
"quantity": 1,
"price": 14,
"each": "$14.00"
},
{
"name": "NUDIE ORANGE JUICE 2LITRE",
"quantity": 2,
"price": 19,
"each": "$9.50 EACH"
},
{
"name": "A2 DAIRY FULL CREAM 2LITRE",
"quantity": 2,
"price": 13.8,
"each": "$6.90 EACH"
},
{
"name": "% COLES PIZZA SUPREME 600GRAM",
"quantity": 1,
"price": 10,
"each": "$10.00"
},
{
"name": "ICEBERG COS SALAD 500GRAM",
"quantity": 1,
"price": 5,
"each": "$5.00"
},
{
"name": "BABY LEAF BLEND 300GRAM",
"quantity": 1,
"price": 5,
"each": "$5.00"
},
{
"name": "* TWININGS TEA BAGS IN 100PACK",
"quantity": 1,
"price": 6.75,
"each": "$6.75"
},
{
"name": "% COLES FZ CONVENIENCE 375GRAM",
"quantity": 4,
"price": 4,
"each": "$4.00"
},
{
"name": "% COLES MIS SATAY CHIC 375GRAM",
"quantity": 1,
"price": 4,
"each": "$4.00"
},
{
"name": "COLES MEALS 3 FOR $10.95",
"quantity": 1,
"price": -1.05,
"each": "-$1.05"
},
{
"name": "% PARKERS PRETZELS ORI 150GRAM",
"quantity": 1,
"price": 4.5,
"each": "$4.50"
},
{
"name": "% COBS SWEET & SALTY 65GRAM",
"quantity": 1,
"price": 4,
"each": "$4.00"
},
{
"name": "CHEEZELS JUMPYS 2 FOR $7",
"quantity": 1,
"price": -1.5,
"each": "-$1.50"
},
{
"name": "* JALNA KIDS ORGANIC Y 100GRAM",
"quantity": 4,
"price": 6,
"each": "$1.50 EACH"
},
{
"name": "* JALNA KIDS ORGANIC Y 100GRAM",
"quantity": 1,
"price": 1.5,
"each": "$1.50"
},
{
"name": "% SPC PUREE FRUIT 4PACK",
"quantity": 1,
"price": 4,
"each": "$4.00"
},
{
"name": "* GREENS PANCAKE SHAKE 325GRAM",
"quantity": 1,
"price": 2.8,
"each": "$2.80"
},
{
"name": "% YAKULT 10PK DRINK 65ML",
"quantity": 1,
"price": 7.7,
"each": "$7.70"
},
{
"name": "* LA ESPANOLA MILD FLA 1LITRE",
"quantity": 1,
"price": 18,
"each": "$18.00"
},
{
"name": "% COBRAM ESTATE INFUSE 250ML",
"quantity": 1,
"price": 12,
"each": "$12.00"
},
{
"name": "BABY BROCCOLI BUNCH",
"quantity": 2,
"price": 6.4,
"each": "$3.20 EACH"
},
{
"name": "MAN/VALLEY 12PK FREE 700GRAM",
"quantity": 1,
"price": 7.8,
"each": "$7.80"
},
{
"name": "BANANAS PER KG",
"quantity": 0.761,
"price": 3.42,
"each": "$4.50/KG"
},
{
"name": "WHITE GRAPES PER KG",
"quantity": 1.115,
"price": 6.13,
"each": "$5.50/KG"
},
{
"name": "**MENTOS MULTI MINT 112GRAM",
"quantity": 2.75,
"price": 2.75,
"each": "$2.75"
},
{
"name": "COLES CHICKEN SAUSAGE 550GRAM",
"quantity": 5.9,
"price": 5.9,
"each": "$5.90"
},
{
"name": "* TASSAL SMOKED SALMON 250GRAM",
"quantity": 16,
"price": 16,
"each": "$16.00"
}
],
"gst": 4.67,
"totalAmount": 204.9
}
We have added an extra "each" field to the item listing:
- when the "quantity" field for an item is NOT 1 then there should be a Details Indicator (e.g.
/KGorEACH) inside the value of the "each" field to give more details on those quantities - otherwise it means that there is an error in the detection
In the example above we can see that the following record is wrong
{
"name": "% COLES FZ CONVENIENCE 375GRAM",
"quantity": 4,
"price": 4,
"each": "$4.00"
},
We can see that the "quantity" field is 4 not 1 yet there is NO Details Indicator in the "each" field.
Since there are two consecutive purchases of the same item "COLES FZ CONVENIENCE 375GRAM" printed on the receipt, they might have confused the llama model into the combining them wrongly.
1.2. paddleocr
Your Entity Agent can now use dedicated OCR model (paddleocr) to do a more detailed scan to pick up more information about COLES FZ CONVENIENCE 375GRAM.
Below is the output from paddleocr using the same Coles receipt image above.
[2025/03/17 16:54:58] ppocr INFO: **********17421832757805910224206597936072_crop.jpg**********
[2025/03/17 16:55:13] ppocr INFO: [[[120.0, 19.0], [1126.0, 22.0], [1126.0, 86.0], [120.0, 82.0]], ('Coles Supermarkets Australia Pty Ltd', 0.9541062116622925)]
[2025/03/17 16:55:13] ppocr INFO: [[[182.0, 89.0], [1042.0, 89.0], [1042.0, 141.0], [182.0, 141.0]], ('Tax InvoiceA8N:45 004 189 708', 0.8821277618408203)]
[2025/03/17 16:55:13] ppocr INFO: [[[291.0, 211.0], [1022.0, 224.0], [1018.0, 447.0], [287.0, 434.0]], ('coles', 0.9897330403327942)]
[2025/03/17 16:55:13] ppocr INFO: [[[66.0, 498.0], [929.0, 498.0], [929.0, 550.0], [66.0, 550.0]], ('Store:853-CS BONDI WESTFIELD', 0.9067391157150269)]
[2025/03/17 16:55:13] ppocr INFO: [[[66.0, 561.0], [656.0, 561.0], [656.0, 613.0], [66.0, 613.0]], ('Store Manager: Justin', 0.9600939750671387)]
[2025/03/17 16:55:13] ppocr INFO: [[[62.0, 625.0], [233.0, 625.0], [233.0, 677.0], [62.0, 677.0]], ('Phone:', 0.9903489947319031)]
[2025/03/17 16:55:13] ppocr INFO: [[[361.0, 621.0], [703.0, 621.0], [703.0, 669.0], [361.0, 669.0]], ('0283334800', 0.9272947311401367)]
[2025/03/17 16:55:13] ppocr INFO: [[[58.0, 673.0], [507.0, 673.0], [507.0, 736.0], [58.0, 736.0]], ('Served By:Pinky', 0.9499634504318237)]
[2025/03/17 16:55:13] ppocr INFO: [[[54.0, 736.0], [463.0, 732.0], [463.0, 795.0], [55.0, 800.0]], ('Register: 007', 0.9475355744361877)]
[2025/03/17 16:55:13] ppocr INFO: [[[809.0, 732.0], [1192.0, 732.0], [1192.0, 807.0], [809.0, 807.0]], ('Receipt:96', 0.9633113145828247)]
[2025/03/17 16:55:13] ppocr INFO: [[[58.0, 807.0], [208.0, 807.0], [208.0, 863.0], [58.0, 863.0]], ('Date:', 0.998651385307312)]
[2025/03/17 16:55:13] ppocr INFO: [[[361.0, 803.0], [649.0, 803.0], [649.0, 855.0], [361.0, 855.0]], ('09/03/2025', 0.9963690042495728)]
[2025/03/17 16:55:13] ppocr INFO: [[[816.0, 803.0], [977.0, 803.0], [977.0, 859.0], [816.0, 859.0]], ('Time:', 0.9665578603744507)]
[2025/03/17 16:55:13] ppocr INFO: [[[1042.0, 803.0], [1181.0, 803.0], [1181.0, 859.0], [1042.0, 859.0]], ('12:42', 0.9663459658622742)]
[2025/03/17 16:55:13] ppocr INFO: [[[55.0, 922.0], [379.0, 922.0], [379.0, 985.0], [55.0, 985.0]], ('Description', 0.9937225580215454)]
[2025/03/17 16:55:13] ppocr INFO: [[[1090.0, 922.0], [1137.0, 922.0], [1137.0, 985.0], [1090.0, 985.0]], ('$', 0.9987080097198486)]
[2025/03/17 16:55:13] ppocr INFO: [[[55.0, 1045.0], [816.0, 1045.0], [816.0, 1097.0], [55.0, 1097.0]], ('%SORBENT TOILET ISS Z4PACK', 0.8784918189048767)]
[2025/03/17 16:55:13] ppocr INFO: [[[1046.0, 1045.0], [1192.0, 1045.0], [1192.0, 1100.0], [1046.0, 1100.0]], ('13.00', 0.9984243512153625)]
[2025/03/17 16:55:13] ppocr INFO: [[[113.0, 1104.0], [795.0, 1108.0], [794.0, 1160.0], [113.0, 1156.0]], ('ANGAS PARK PITTED PR 1KG', 0.9217420220375061)]
[2025/03/17 16:55:13] ppocr INFO: [[[1046.0, 1108.0], [1188.0, 1108.0], [1188.0, 1164.0], [1046.0, 1164.0]], ('14.00', 0.9977127909660339)]
[2025/03/17 16:55:13] ppocr INFO: [[[113.0, 1167.0], [817.0, 1171.0], [816.0, 1223.0], [113.0, 1219.0]], ('NUDIE ORANGE JUICE 2IITRE', 0.898023784160614)]
[2025/03/17 16:55:13] ppocr INFO: [[[1042.0, 1171.0], [1188.0, 1171.0], [1188.0, 1227.0], [1042.0, 1227.0]], ('19.00', 0.9985156059265137)]
[2025/03/17 16:55:13] ppocr INFO: [[[200.0, 1231.0], [598.0, 1231.0], [598.0, 1283.0], [200.0, 1283.0]], ('2@$9.50EACH', 0.9500343799591064)]
[2025/03/17 16:55:13] ppocr INFO: [[[117.0, 1290.0], [838.0, 1290.0], [838.0, 1342.0], [117.0, 1342.0]], ('A2 DAIRY FULL CREAM 2LITRE', 0.9141474366188049)]
[2025/03/17 16:55:13] ppocr INFO: [[[1042.0, 1294.0], [1188.0, 1294.0], [1188.0, 1350.0], [1042.0, 1350.0]], ('13.80', 0.9953176379203796)]
[2025/03/17 16:55:13] ppocr INFO: [[[197.0, 1357.0], [598.0, 1357.0], [598.0, 1409.0], [197.0, 1409.0]], ('2@ $6.90 EACH', 0.9151591062545776)]
[2025/03/17 16:55:13] ppocr INFO: [[[58.0, 1416.0], [867.0, 1416.0], [867.0, 1468.0], [58.0, 1468.0]], ('%COLES PIZZA SUPREME 6OOGRAM', 0.9311746954917908)]
[2025/03/17 16:55:13] ppocr INFO: [[[1042.0, 1416.0], [1188.0, 1416.0], [1188.0, 1472.0], [1042.0, 1472.0]], ('10.00', 0.997810959815979)]
[2025/03/17 16:55:13] ppocr INFO: [[[117.0, 1480.0], [816.0, 1480.0], [816.0, 1532.0], [117.0, 1532.0]], ('ICEBERG COS SALAD 5OOGRAM', 0.9468113780021667)]
[2025/03/17 16:55:13] ppocr INFO: [[[1064.0, 1480.0], [1188.0, 1480.0], [1188.0, 1535.0], [1064.0, 1535.0]], ('5.00', 0.9985412359237671)]
[2025/03/17 16:55:13] ppocr INFO: [[[113.0, 1539.0], [758.0, 1539.0], [758.0, 1591.0], [113.0, 1591.0]], ('BABY LEAF BIEND 3OOGRAM', 0.8851689100265503)]
[2025/03/17 16:55:13] ppocr INFO: [[[1064.0, 1531.0], [1190.0, 1540.0], [1185.0, 1600.0], [1059.0, 1590.0]], ('5.00', 0.9977185130119324)]
[2025/03/17 16:55:13] ppocr INFO: [[[51.0, 1598.0], [893.0, 1606.0], [893.0, 1658.0], [51.0, 1651.0]], ('* TWININGS TEA BAGS 1OOPACK', 0.9123839139938354)]
[2025/03/17 16:55:13] ppocr INFO: [[[1061.0, 1599.0], [1192.0, 1599.0], [1192.0, 1666.0], [1061.0, 1666.0]], ('6.75', 0.9954995512962341)]
[2025/03/17 16:55:13] ppocr INFO: [[[51.0, 1662.0], [900.0, 1666.0], [900.0, 1718.0], [51.0, 1714.0]], ('%COLES FZ CONVENIENCE 375GRAM', 0.9101614356040955)]
[2025/03/17 16:55:13] ppocr INFO: [[[1064.0, 1666.0], [1188.0, 1666.0], [1188.0, 1721.0], [1064.0, 1721.0]], ('4.00', 0.973802924156189)]
[2025/03/17 16:55:13] ppocr INFO: [[[48.0, 1725.0], [904.0, 1729.0], [904.0, 1781.0], [47.0, 1777.0]], ('%COLES FZ CONVENIENCE 375GRAM', 0.9086523652076721)]
[2025/03/17 16:55:13] ppocr INFO: [[[1072.0, 1729.0], [1188.0, 1729.0], [1188.0, 1784.0], [1072.0, 1784.0]], ('4.00', 0.9838540554046631)]
[2025/03/17 16:55:13] ppocr INFO: [[[55.0, 1792.0], [904.0, 1792.0], [904.0, 1844.0], [55.0, 1844.0]], ('%COLES MIS SATAY CHIC 375GRAM', 0.9228101968765259)]
[2025/03/17 16:55:13] ppocr INFO: [[[1064.0, 1792.0], [1192.0, 1792.0], [1192.0, 1848.0], [1064.0, 1848.0]], ('4.00', 0.9923299551010132)]
[2025/03/17 16:55:13] ppocr INFO: [[[55.0, 1851.0], [736.0, 1851.0], [736.0, 1903.0], [55.0, 1903.0]], ('COLES MLAIS3FOR $10.95', 0.8726086020469666)]
[2025/03/17 16:55:13] ppocr INFO: [[[1039.0, 1855.0], [1188.0, 1855.0], [1188.0, 1911.0], [1039.0, 1911.0]], ('$1.05', 0.9948092699050903)]
[2025/03/17 16:55:13] ppocr INFO: [[[55.0, 1915.0], [900.0, 1915.0], [900.0, 1967.0], [55.0, 1967.0]], ('%PARKERS PREIZELS ORI 15OGRAM', 0.908936083316803)]
[2025/03/17 16:55:13] ppocr INFO: [[[1068.0, 1915.0], [1188.0, 1915.0], [1188.0, 1970.0], [1068.0, 1970.0]], ('4.50', 0.9975542426109314)]
[2025/03/17 16:55:13] ppocr INFO: [[[55.0, 1978.0], [816.0, 1978.0], [816.0, 2030.0], [55.0, 2030.0]], ('%COBS SWFF & SALTY 65GRAM', 0.8570607900619507)]
[2025/03/17 16:55:13] ppocr INFO: [[[1068.0, 1978.0], [1188.0, 1978.0], [1188.0, 2034.0], [1068.0, 2034.0]], ('4.00', 0.9980174899101257)]
[2025/03/17 16:55:13] ppocr INFO: [[[51.0, 2037.0], [736.0, 2041.0], [736.0, 2093.0], [51.0, 2089.0]], ('CHEEZELS JUMPYS 2 FOR $7', 0.9253003001213074)]
[2025/03/17 16:55:13] ppocr INFO: [[[1032.0, 2041.0], [1192.0, 2041.0], [1192.0, 2097.0], [1032.0, 2097.0]], ('$1.50', 0.9958810806274414)]
[2025/03/17 16:55:13] ppocr INFO: [[[55.0, 2101.0], [900.0, 2101.0], [900.0, 2153.0], [55.0, 2153.0]], ('*JALNA KJDS ORGANIC Y 1OOGRAM', 0.9079824090003967)]
[2025/03/17 16:55:13] ppocr INFO: [[[1057.0, 2097.0], [1196.0, 2097.0], [1196.0, 2164.0], [1057.0, 2164.0]], ('6.00', 0.9981706738471985)]
[2025/03/17 16:55:13] ppocr INFO: [[[190.0, 2164.0], [609.0, 2164.0], [609.0, 2212.0], [190.0, 2212.0]], ('4@$1.50EACH', 0.965267539024353)]
[2025/03/17 16:55:13] ppocr INFO: [[[44.0, 2216.0], [904.0, 2220.0], [904.0, 2283.0], [44.0, 2279.0]], ('*JALNA KIDS ORGANIC Y 1OOGRAM', 0.9236149191856384)]
[2025/03/17 16:55:13] ppocr INFO: [[[1068.0, 2219.0], [1196.0, 2219.0], [1196.0, 2286.0], [1068.0, 2286.0]], ('1.50', 0.9949904680252075)]
[2025/03/17 16:55:13] ppocr INFO: [[[48.0, 2282.0], [704.0, 2290.0], [703.0, 2342.0], [47.0, 2335.0]], ('*SPC PUREE FRUIT 4PACK', 0.9326660633087158)]
[2025/03/17 16:55:13] ppocr INFO: [[[1068.0, 2283.0], [1196.0, 2283.0], [1196.0, 2350.0], [1068.0, 2350.0]], ('4.00', 0.997651219367981)]
[2025/03/17 16:55:13] ppocr INFO: [[[51.0, 2353.0], [904.0, 2353.0], [904.0, 2405.0], [51.0, 2405.0]], ('*GREENS PANCAKE SHAKE 325GRAM', 0.9532975554466248)]
[2025/03/17 16:55:13] ppocr INFO: [[[1061.0, 2346.0], [1196.0, 2346.0], [1196.0, 2413.0], [1061.0, 2413.0]], ('2.80', 0.997504472732544)]
[2025/03/17 16:55:13] ppocr INFO: [[[48.0, 2409.0], [729.0, 2413.0], [729.0, 2465.0], [47.0, 2461.0]], ('%YAKULT 1OPK DRINK 65M', 0.9067224860191345)]
[2025/03/17 16:55:13] ppocr INFO: [[[1064.0, 2409.0], [1196.0, 2409.0], [1196.0, 2476.0], [1064.0, 2476.0]], ('7.70', 0.995763897895813)]
[2025/03/17 16:55:13] ppocr INFO: [[[55.0, 2476.0], [871.0, 2476.0], [871.0, 2528.0], [55.0, 2528.0]], ('*L.a Espanola Mi ld Fla 1LITRE', 0.9011823534965515)]
[2025/03/17 16:55:13] ppocr INFO: [[[1046.0, 2476.0], [1192.0, 2476.0], [1192.0, 2532.0], [1046.0, 2532.0]], ('18.00', 0.9976032972335815)]
[2025/03/17 16:55:13] ppocr INFO: [[[113.0, 2539.0], [838.0, 2539.0], [838.0, 2591.0], [113.0, 2591.0]], ('COBRAM ESTATE INFUSE 25OML', 0.9367403388023376)]
[2025/03/17 16:55:13] ppocr INFO: [[[1046.0, 2539.0], [1192.0, 2539.0], [1192.0, 2595.0], [1046.0, 2595.0]], ('12.00', 0.9966100454330444)]
[2025/03/17 16:55:13] ppocr INFO: [[[102.0, 2591.0], [682.0, 2595.0], [681.0, 2658.0], [102.0, 2654.0]], ('BABY BROCCOLI 1BUNCH', 0.948756992816925)]
[2025/03/17 16:55:13] ppocr INFO: [[[1061.0, 2602.0], [1192.0, 2602.0], [1192.0, 2658.0], [1061.0, 2658.0]], ('6.40', 0.997553825378418)]
[2025/03/17 16:55:13] ppocr INFO: [[[190.0, 2662.0], [598.0, 2662.0], [598.0, 2714.0], [190.0, 2714.0]], ('2@$3.20EACH', 0.9643623232841492)]
[2025/03/17 16:55:13] ppocr INFO: [[[109.0, 2725.0], [900.0, 2725.0], [900.0, 2777.0], [109.0, 2777.0]], ('MAN/VALLEY 12PK FREE 700GRAM', 0.9246994256973267)]
[2025/03/17 16:55:13] ppocr INFO: [[[1064.0, 2721.0], [1192.0, 2721.0], [1192.0, 2777.0], [1064.0, 2777.0]], ('7.80', 0.993127703666687)]
[2025/03/17 16:55:13] ppocr INFO: [[[109.0, 2788.0], [481.0, 2788.0], [481.0, 2840.0], [109.0, 2840.0]], ('BANANAS PERKG', 0.977373480796814)]
[2025/03/17 16:55:13] ppocr INFO: [[[1061.0, 2781.0], [1192.0, 2781.0], [1192.0, 2848.0], [1061.0, 2848.0]], ('3.42', 0.9966561198234558)]
[2025/03/17 16:55:13] ppocr INFO: [[[179.0, 2840.0], [849.0, 2844.0], [849.0, 2911.0], [178.0, 2907.0]], ('0.761 kg NET@$4.50/kg', 0.9115961790084839)]
[2025/03/17 16:55:13] ppocr INFO: [[[109.0, 2915.0], [616.0, 2915.0], [616.0, 2967.0], [109.0, 2967.0]], ('WHITE GRAPES PERKG', 0.9367444515228271)]
[2025/03/17 16:55:13] ppocr INFO: [[[1061.0, 2907.0], [1196.0, 2907.0], [1196.0, 2978.0], [1061.0, 2978.0]], ('6.13', 0.9964463710784912)]
[2025/03/17 16:55:13] ppocr INFO: [[[186.0, 2978.0], [842.0, 2978.0], [842.0, 3030.0], [186.0, 3030.0]], ('1.115 kg NET @ $5.50/kg', 0.9174103736877441)]
[2025/03/17 16:55:13] ppocr INFO: [[[55.0, 3041.0], [846.0, 3041.0], [846.0, 3089.0], [55.0, 3089.0]], ('*%MENTOS MULTIMINT 112GRAM', 0.9260384440422058)]
[2025/03/17 16:55:13] ppocr INFO: [[[1064.0, 3037.0], [1188.0, 3037.0], [1188.0, 3093.0], [1064.0, 3093.0]], ('2.75', 0.9959260821342468)]
[2025/03/17 16:55:13] ppocr INFO: [[[1061.0, 3093.0], [1192.0, 3093.0], [1192.0, 3160.0], [1061.0, 3160.0]], ('5.90', 0.9980429410934448)]
[2025/03/17 16:55:13] ppocr INFO: [[[51.0, 3167.0], [904.0, 3167.0], [904.0, 3216.0], [51.0, 3216.0]], ('*TASSAL SMOKED SALMON 25OGRAM', 0.9400425553321838)]
[2025/03/17 16:55:13] ppocr INFO: [[[1042.0, 3160.0], [1196.0, 3160.0], [1196.0, 3227.0], [1042.0, 3227.0]], ('16.00', 0.9965184926986694)]
[2025/03/17 16:55:13] ppocr INFO: [[[51.0, 3286.0], [594.0, 3286.0], [594.0, 3350.0], [51.0, 3350.0]], ('Total for 33 itens:', 0.9194560647010803)]
[2025/03/17 16:55:13] ppocr INFO: [[[988.0, 3286.0], [1196.0, 3286.0], [1196.0, 3353.0], [988.0, 3353.0]], ('$204.90', 0.9984193444252014)]
[2025/03/17 16:55:13] ppocr INFO: [[[47.0, 3413.0], [146.0, 3413.0], [146.0, 3472.0], [47.0, 3472.0]], ('EFT', 0.9962754845619202)]
[2025/03/17 16:55:13] ppocr INFO: [[[984.0, 3409.0], [1192.0, 3409.0], [1192.0, 3476.0], [984.0, 3476.0]], ('$204.90', 0.9970187544822693)]
[2025/03/17 16:55:13] ppocr INFO: [[[47.0, 3480.0], [645.0, 3480.0], [645.0, 3543.0], [47.0, 3543.0]], ('GST INCLUDED IN TOTAL', 0.9515725374221802)]
[2025/03/17 16:55:13] ppocr INFO: [[[1035.0, 3476.0], [1192.0, 3476.0], [1192.0, 3543.0], [1035.0, 3543.0]], ('$4.67', 0.9947670698165894)]
Your entity agent can now clearly see that there are four consecutive lines with two "COLES FZ CONVENIENCE 375GRAM" and "4.00" one after another:
'%COLES FZ CONVENIENCE 375GRAM'
'4.00'
'%COLES FZ CONVENIENCE 375GRAM'
'4.00'
It can then perform any necessary corrections if required.
Note in this case, Coles' simple top-down receipt design means there is no need to use the associated bounding boxes (defined by 4 points) displayed next to each detected item above.
Final Result
Merging results from different models can produce almost perfect results. Below json output is from the same image scale down to the Team Compute standard image size (maximum length of 2000px for all 4 sides).
{
"retailer": "Coles Supermarkets Australia Pty Ltd",
"abn": "45 004 189 708",
"store": "853 - CS BONDI WESTFIELD",
"store_manager": "Justin",
"phone": "02 8383 4800",
"served_by": "Pinky",
"register": "007",
"receipt_number": "96",
"date": "09/03/2025",
"time": "12:42",
"items": [
{
"description": "% SORBENT TOILET TSS 24PACK",
"price": "$13.00"
},
{
"description": "ANGAS PARK PITTED PR PR 1KG",
"price": "$14.00"
},
{
"description": "NUDIE ORANGE JUICE 2LITRE",
"quantity": "2",
"price_each": "$9.50",
"total_price": "$19.00"
},
{
"description": "A2 DAIRY FULL CREAM 2LITRE",
"quantity": "2",
"price_each": "$6.90",
"total_price": "$13.80"
},
{
"description": "% COLES PIZZA SUPREME 600GRAM",
"price": "$10.00"
},
{
"description": "ICEBERG COS SALAD 500GRAM",
"price": "$5.00"
},
{
"description": "BABY LEAF BLEND 300GRAM",
"price": "$5.00"
},
{
"description": "* TWININGS TEA BAGS EN 100PACK",
"price": "$6.75"
},
{
"description": "% COLES FZ CONVENIENCE 375GRAM",
"price": "$4.00"
},
{
"description": "% COLES FZ CONVENIENCE 375GRAM",
"price": "$4.00"
},
{
"description": "% COLES MLS SATAY CHIC 375GRAM",
"price": "$4.00"
},
{
"description": "COLES MEALS 3 FOR $10.95",
"price": "-$1.05"
},
{
"description": "% PARKERS PRETZELS ORI 150GRAM",
"price": "$4.50"
},
{
"description": "% COBS SWEET & SALTY 65GRAM",
"price": "$4.00"
},
{
"description": "CHEEZELS JUMPYS 2 FOR $7",
"price": "-$1.50"
},
{
"description": "* JALNA KIDS ORGANIC Y 100GRAM",
"quantity": "4",
"price_each": "$1.50",
"total_price": "$6.00"
},
{
"description": "* JALNA KIDS ORGANIC Y 100GRAM",
"price": "$1.50"
},
{
"description": "* SPC PUREE FRUIT 4PACK",
"price": "$4.00"
},
{
"description": "* GREENS PANCAKE SHAKE 325GRAM",
"price": "$2.80"
},
{
"description": "% YAKULT 10PK DRINK 65ML",
"price": "$7.70"
},
{
"description": "* La Espanola Mild Fla 1LITRE",
"price": "$18.00"
},
{
"description": "COBRAM ESTATE INFUSE 250ML",
"price": "$12.00"
},
{
"description": "BABY BROCCOLI 1BUNCH",
"quantity": "2",
"price_each": "$3.20",
"total_price": "$6.40"
},
{
"description": "MAN/VALLEY 12PK FREE 700GRAM",
"price": "$7.80"
},
{
"description": "BANANAS VALLEY PERKG",
"weight": "0.761 kg",
"price_per_kg": "$4.50/kg",
"total_price": "$3.42"
},
{
"description": "WHITE GRAPE PERKG",
"weight": "1.115 kg",
"price_per_kg": "$5.50/kg",
"total_price": "$6.13"
},
{
"description": "*%MENTOS MULTI MINT 112GRAM",
"price": "$2.75"
},
{
"description": "COLES CHICKEN SAUSAG 550GRAM",
"price": "$5.90"
},
{
"description": "* TASSAL SMOKED SALMON 250GRAM",
"price": "$16.00"
}
],
"total_items": "33",
"total": "$204.90",
"gst": "$4.67"
}