# Collaboration call - photometric methods for visual tracking

**URL:** <https://discourse.julialang.org/t/collaboration-call-photometric-methods-for-visual-tracking/111926>\
**Category:** Community\
**Tags:** computer-vision\
**Created:** [March 21, 2024, 10:03am UTC](https://discourse.julialang.org/t/collaboration-call-photometric-methods-for-visual-tracking/111926 "2024-03-21T10:03:30Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![user664303](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/user664303/32/37843_2.png) [@user664303](https://discourse.julialang.org/u/user664303)\
**Post date:** [March 21, 2024, 10:03am UTC](https://discourse.julialang.org/t/collaboration-call-photometric-methods-for-visual-tracking/111926/1 "2024-03-21T10:03:30Z")

</div>

I’m seeking one or more collaborators to help implement an open-source Julia implementation of a photometric method (sometimes also referred to as a direct method) for visual tracking, i.e. tracking objects or camera motion in video.

I developed and implemented this framework in C++ at a company I worked at previously. It was state of the art in terms of it’s accuracy and robustness, especially in the face of local brightness changes. It can be applied to rigid 3D object tracking, camera calibration, visual odometry, SLAM, and large scale scene reconstruction.

The method has been published, but no implementation has been released publicly (that I’m aware of) in any language. This project is therefore an opportunity for the Julia ecosystem to have the state of the art method, and attract more people to Julia.

I have already implemented the [non-linear solver](https://github.com/ojwoodford/NLLSsolver.jl) part of the framework. However, I’ve ground to a bit of a halt with the next steps. I would love to work with a motivated programmer to get the rest done. I can offer tuition on the method, and design and review of the implementation.

I’m happy to share details and results with anyone who has a genuine interest in collaborating, to give an idea of what the method is capable of.

---

<div class="post-metadata">

**Author:** ![yakir12](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/yakir12/32/297_2.png) [@yakir12](https://discourse.julialang.org/u/yakir12)\
**Post date:** [March 22, 2024, 10:17am UTC](https://discourse.julialang.org/t/collaboration-call-photometric-methods-for-visual-tracking/111926/2 "2024-03-22T10:17:36Z")

</div>

I’d be very interested in this project, and would love to help as much as I can. I’m not sure how much I will be able to help however.

This is super exciting!

---

<div class="post-metadata">

**Author:** ![mihalybaci](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/mihalybaci/32/13528_2.png) [@mihalybaci](https://discourse.julialang.org/u/mihalybaci)\
**Post date:** [March 22, 2024, 11:54am UTC](https://discourse.julialang.org/t/collaboration-call-photometric-methods-for-visual-tracking/111926/3 "2024-03-22T11:54:54Z")

</div>

I’m not sure how much of the methods/designs overlap, but @baggepinnen has BlobTracking.jl that appears to have video tracking capabilities.

> [@\[ANN\] BlobTracking](https://discourse.julialang.org/t/ann-blobtracking/33291):
>
> I was searching around for packages or examples of [blob tracking](https://en.wikipedia.org/wiki/Blob_detection) using Julia. To my surprise, I found nothing. Since I needed to do some blob tracking for the purpose of counting birds, I made a small package that can hopefully be useful to the next person who find themselves in need of tracking something moving around in an image and is unwilling to leave the warm comfort of Julia land. [BlobTracking.jl](https://github.com/baggepinnen/BlobTracking.jl) Blobs are detected using simple [Laplacian-of-Gaussian filtering](https://en.wikipedia.org/wiki/Blob_detection) (from [Images.jl](https://juliaimages.org/latest/function_reference/#Images.blob_LoG)) and tracke…

---

<div class="post-metadata">

**Author:** ![baggepinnen](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/baggepinnen/32/693_2.png) [@baggepinnen](https://discourse.julialang.org/u/baggepinnen)\
**Post date:** [March 22, 2024, 12:10pm UTC](https://discourse.julialang.org/t/collaboration-call-photometric-methods-for-visual-tracking/111926/4 "2024-03-22T12:10:52Z")

</div>

My guess would be _very little_ overlap. Also, BlobTracking.jl hasn’t been touched in ages, so I encourage you to disregard it

---

<div class="post-metadata">

**Author:** ![Priya\_TAMILSELVAN](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/priya_tamilselvan/32/208004_2.png) [@Priya\_TAMILSELVAN](https://discourse.julialang.org/u/Priya_TAMILSELVAN)\
**Post date:** [March 26, 2024, 10:36am UTC](https://discourse.julialang.org/t/collaboration-call-photometric-methods-for-visual-tracking/111926/5 "2024-03-26T10:36:13Z")

</div>

Hello, I am excited to be a part of this collaboration. Not sure how much I can offer but will be actively available to give a shot at it.

---

<div class="post-metadata">

**Author:** ![user664303](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/user664303/32/37843_2.png) [@user664303](https://discourse.julialang.org/u/user664303)\
**Post date:** [April 10, 2024, 9:06pm UTC](https://discourse.julialang.org/t/collaboration-call-photometric-methods-for-visual-tracking/111926/6 "2024-04-10T21:06:48Z")

</div>

Just a quick note to say that I appreciate all offers made 🙏, and have & will DM anyone wanting to collaborate.

---

<div class="post-metadata">

**Author:** ![jar1](https://avatars.discourse-cdn.com/v4/letter/j/c0e974/32.png) [@jar1](https://discourse.julialang.org/u/jar1)\
**Post date:** [April 10, 2024, 9:15pm UTC](https://discourse.julialang.org/t/collaboration-call-photometric-methods-for-visual-tracking/111926/7 "2024-04-10T21:15:56Z")

</div>

Fwiw the annual [“Summer of Code”](https://summerofcode.withgoogle.com/programs/2024) program makes small amounts of funding available for project mentorships of this kind.