Posts

In online applications customer journey identification and conversion tracking are essential to grow any business. The customer journey starts with a customer reaching the landing page and browsing / engaging with the content before the customer makes a purchase/logs in. It is important to tie this anonymous behaviour with the existing customer behaviour to Personalize content like recommend products that are useful to the customer. Understand if the landing page conversion to take an action like purchase are meaningful. Identify and filter out bots from customer behavioural data. Below is a simple and quick fingerprinting system design. ...

Large Language Models (LLMs) provide different outputs for the same input despite setting temperature as zero - which makes sampling deterministic eliminating variance in output. This has been attributed to two main sources: floating point arithmetic, and Parallelism in GPU. Together they tend to make floating point arithmetic non-associative. a+(b+c)≠(a+b)+c a + (b + c) \neq (a + b) + c a+(b+c)=(a+b)+cWe can think of this as GPU cores in parallel do computation, which results in nondeterministic sequence of values. And when we do floating point math on these, it results in different values. ...