Taw qhia
Thaum akoob yees duab modulecaptures ib daim duab, cov ntaub ntawv raw los ntawm covcmos koob yees duab modulesensor tseem tsis tau pom daim duab. Nws yuav tsum tau ua tiav - demosaiced, dawb-balanced, suab nrov-txo, thiab sharpened. Qhov no yog ua los ntawm ib tugImage Signal Processor (ISP). Lub ISP tuaj yeem yog lub siab tawv nti (hardware ISP) lossis lub tsev qiv ntawv software khiav ntawm lub ntsiab processor (software ISP). Kab lus no sib pivhardware ISP vs software ISP, lawv qhov zoo thiab qhov tsis zoo, thiab qhov twg yog qhov zoo rau koj daim ntawv thov.
ISP yog dab tsi?
Ib qho ISP hloov cov ntaub ntawv nyoos Bayer rau hauv daim duab kawg. Cov haujlwm tseem ceeb:
Demosaicing - interpolating xim.
Dawb tshuav - neutralizing xim cam khwb cia.
Txo suab nrov - tshem tawm cov nplej.
Sharpening - txhim kho cov npoo.
Gamma kho - kho qhov ci.
Ib qho ISP zoo tuaj yeem ua kom lub ntsej muag me me saib zoo; ISP tsis zoo tuaj yeem ua rau lub siab kawg4K koob yees duab module.
Hardware ISP – Dedicated Chip
Ib qho khoom siv ISP yog ib qho nyias nyias lossis thaiv hauv lub sensor lossis processor. Nws khiav hauv lub sijhawm tiag tiag, siv lub zog CPU tsawg heev.
Qhov zoo
- Tsawg latency- txheej txheem txhua tus ncej tam sim; zoo tagnrho rau nyob video (endoscopy, drones).
- Tsawg zog- Kev siv hluav taws xob siv hluav taws xob tsawg dua li CPU.
- Zoo ib yam- tsau algorithm, tsis muaj variability.
- Ua haujlwm CPU- tawm lub ntsiab processor dawb rau lwm yam dej num.
Qhov tsis zoo
- Tsau- tsis tuaj yeem hloov kho lossis hloov kho tom qab tsim khoom.
- Ntxiv tus nqi- yuav tsum tau ntxiv nti lossis ntau dua sensor.
- Yooj yim dua- tej zaum yuav tsis txhawb kev cai xim nkhaus los yog siab heev denoising.
Hardware ISP muaj nyob rau hauv smartphones, lub koob yees duab ua haujlwm, thiab ntau yamhd koob yees duab modulecov khoom.
- Software ISP - Kev ua haujlwm ntawm Main CPU
Ib qho software ISP yog lub tsev qiv ntawv (OpenCV, libraw, lossis kev cai code) khiav ntawm tus tswv CPU, GPU, lossis DSP.
Qhov zoo
- Yooj yim- algorithms tuaj yeem hloov kho kom zoo dua lossis ntxiv cov yam ntxwv.
- Tsis muaj hardware ntxiv- txo cov nqi tiv thaiv.
- Customizable- Koj tuaj yeem ua raws li kev tshawb fawb xim lossis kev ua haujlwm tshwj xeeb (kev kho mob, tshuab pom).
- Muaj peev xwm muaj zog dua- ntawm CPU muaj zog, koj tuaj yeem khiav AI-raws li kev txo qis lossis HDR siab heev.
Qhov tsis zoo
- Siab CPU load- tej zaum yuav cuam tshuam lwm yam hauj lwm, tshwj xeeb tshaj yog nyob rau hauv embedded systems.
- Siab zog- ua cov duab ntawm lub hom phiaj dav dav CPU siv zog ntau dua.
- Siab dua latency- nyob ntawm CPU ceev; tej zaum yuav ua rau tus ncej poob.
Software ISP yog muaj nyob rau hauv PC-raws li lub koob yees duab,4K koob yees duab modulesystems nrog haib processors, thiab prototyping.
Lub rooj sib piv
| Yam | Hardware ISP | Software ISP |
|---|---|---|
| Latency | Tsawg heev (µs) | Siab dua (ms) |
| Hwj chim | Tsawg | Siab |
| CPU load | Tsis muaj | Qhov tseem ceeb |
| Yooj yim | Tsau | Hloov tau yooj yim |
| Nqi | Ntxiv nti | Tsis muaj nti, tab sis tej zaum yuav xav tau CPU ceev dua |
| Zoo tshaj rau | Real-time, roj teeb-powered | PC-raws li, kev cai ua |
Piv txwv
- HD Lub Koob Yees Duab Module nrog Hardware ISP- Ib yamhd koob yees duab module(1080p) rau USB webcam lossis endoscope feem ntau koom nrog ISP kho vajtse. Nws outputs processed YUV lossis MJPEG, thiab tus tswv tsev tsuas yog qhia cov duab. Qhov no yooj yim, tsis muaj zog, thiab ua haujlwm ntawm txhua lub computer.
- 4K Lub Koob Yees Duab Module nrog Software ISP – A 4K koob yees duab moduleuas tso tawm cov ntaub ntawv nyoos Bayer xav tau software ISP ntawm tus tswv tsev. Qhov no yog ib txwm muaj nyob rau hauv high-end tshuab pom los yog kev cai embedded systems uas tus tsim tawm xav kom tag nrho cov tswj. Tus tswv tsev yuav tsum muaj CPU ceev (piv txwv li, NVIDIA Jetson, desktop PC).
- CMOS Lub Koob Yees Duab Module - Ob qho kev xaiv – A cmos koob yees duab moduletuaj yeem xaj nrog lossis tsis muaj ISP kho vajtse. Raw cov zis muab yooj yooj yim; hardware ISP muab kev yooj yim.
Koj yuav tsum xaiv qhov twg?
| Koj Qhov Tseem Ceeb | Kev pom zoo |
|---|---|
| Tsawg zog, roj teeb lub neej ntev | Hardware ISP |
| Tsawg tshaj latency | Hardware ISP |
| Yooj yim tshaj plaws, kev cai algorithms | Software ISP |
| Yooj yim PC kev koom ua ke | Hardware ISP |
| Cov khoom me me (tsis muaj processor ntxiv) | Hardware ISP |
| 4K video ntawm tus nqi qis CPU | Hardware ISP ( txwv tsis pub CPU yuav tawm tsam) |
Sincere's Camera Modules
Ntawm Sincere, peb muabkoob yees duab modulekev daws teeb meem nrog ob qho tib si kho vajtse thiab software ISP:
- Hardware ISP- Kev sib xyaw ua ke rau kev ua haujlwm qis, ntsaws thiab ua si.
- Software ISP- Cov khoom siv raw khoom rau kev ua haujlwm ntawm koj tus tswv tsev (ARM, FPGA, PC).
- HD koob yees duab module- Muaj nrog kho vajtse ISP lossis cov khoom siv raw.
- 4K koob yees duab module- Kho vajtse ISP pom zoo rau cov neeg siv feem ntau; raw rau cov kws tshaj lij.
Cov ntsiab lus
Qhov kev xaiv ntawmhardware ISP vs software ISPlos rau lub hwj chim, latency, yooj, thiab CPU cov peev txheej. Hardware ISP yog ceev, ua tau zoo, thiab yooj yim – zoo rau roj teeb-poweredhd koob yees duab modulekhoom siv. Software ISP muab rau koj tag nrho kev tswj hwm thiab kev txhim kho, tab sis xav tau lub processor muaj zog thiab siv zog ntau dua. Rau ib4K koob yees duab module, hardware ISP feem ntau yog qhov kev xaiv zoo kom tsis txhob overloading tus tswv tsev. Kev nkag siab qhov no yuav pab koj xaiv qhov yogcmos koob yees duab modulerau koj qhov project.
