Results 1 to 3 of 3
  1. #1

    Missing updates on DISTINCT mode

    Hi.

    We are experiencing some missing updates to the clients when we have a field with some kb. Take the example below:

    Code:
    23-jul-20 13:41:19,654|DEBUG|L.subscriptions.upd|TER_V2 simple updates queue|INCOMING DATA for snpsht_10:PETR3_ab54b561a58192f8219d1bf4fb501d12 on CDS_ADAPTER.LIVRO_ADAPTER_V2 --> {a=10:PETR3, ab54b561a58192f8219d1bf4fb501d12=<ra=10:PETR3 s=254360^41=800|42=16:41:17|40=23.7|43=10:1618||41=500|42=16:41:17|40=23.7|43=10:8||41=800|42=16:41:17|40=23.7|43=10:8||41=500|42=16:41:17|40=23.7|43=10:8||41=1600|42=16:41:17|40=23.7|43=10:16||41=500|42=16:41:17|40=23.7|43=10:8||41=100|42=16:41:17|40=23.7|43=10:127||41=700|42=16:41:17|40=23.7|43=10:3||41=600|42=16:41:18|40=23.7|43=10:8||41=100|42=16:41:18|40=23.7|43=10:40||41=600|42=16:41:19|40=23.7|43=10:120||41=2300|42=16:41:19|40=23.7|43=10:120||41=500|42=16:41:06|40=23.69|43=10:1618||41=800|42=16:41:00|40=23.69|43=10:8||41=500|42=16:41:00|40=23.69|43=10:8||41=500|42=16:41:00|40=23.69|43=10:8||41=600|42=16:41:01|40=23.69|43=10:8||41=2300|42=16:41:08|40=23.69|43=10:120||41=1300|42=16:41:08|40=23.69|43=10:120||41=6000|42=16:41:09|40=23.69|43=10:45||41=800|42=16:41:09|40=23.69| ... cut
    
    23-jul-20 13:41:19,655|DEBUG|L.subscriptions.upd|TER_V2 simple updates queue|INCOMING DATA for snpsht_10:PETR3_ab54b561a58192f8219d1bf4fb501d12 on CDS_ADAPTER.LIVRO_ADAPTER_V2 --> {a=10:PETR3, ab54b561a58192f8219d1bf4fb501d12=<Ra=10:PETR3 s=254361^41=300|42=16:41:19|40=23.71|43=10:8||41=100|42=16:41:19|40=23.71|43=10:40||41=1700|40=23.72|43=10:85||41=2300|42=15:24:35|40=23.72|43=10:120||41=600|42=16:27:45|40=23.72|43=10:8||41=7500|42=16:27:47|40=23.72|43=10:45||41=500|42=16:32:14|40=23.72|43=10:8||41=800|42=16:32:14|40=23.72|43=10:8||41=500|42=16:40:44|40=23.72|43=10:8||41=600|42=16:40:46|40=23.72|43=10:1618||41=800|42=16:41:11|40=23.72|43=10:1618||41=1000|42=16:41:11|40=23.72|43=10:3||41=1000|42=16:41:16|40=23.72|43=10:1618||41=2300|42=15:39:46|40=23.73|43=10:120||41=1000|42=15:39:47|40=23.73|43=10:1618||41=1300|42=15:41:52|40=23.73|43=10:120||41=1000|42=15:45:27|40=23.73|43=10:308||41=7500|42=16:28:20|40=23.73|43=10:45||41=800|42=16:34:44|40=23.73|43=10:8||41=600|42=16:35:11|40=23.73|43=10:8||41=500|42=16:35:39|40=23.73|.... cut
    
    23-jul-20 13:41:19,683|DEBUG|L.pump             |PUMP POOLED THREAD 23      |Pumping event in session S23bccbae60131c8cM90fT4020694: U,46,1,R|<Ra=10:PETR3 s=254361^41=300%7C42=16:41:19%7C40=23.71%7C43=10:8%7C%7C41=100%7C42=16:41:19%7C40=23.71%7C43=10:40%7C%7C41=1700%7C40=23.72%7C43=10:85%7C%7C41=2300%7C42=15:24:35%7C40=23.72%7C43=10:120%7C%7C41=600%7C42=16:27:45%7C40=23.72%7C43=10:8%7C%7C41=7500%7C42=16:27:47%7C40=23.72%7C43=10:45%7C%7C41=500%7C42=16:32:14%7C40=23.72%7C43=10:8%7C%7C41=800%7C42=16:32:14%7C40=23.72%7C43=10:8%7C%7C41=500%7C42=16:40:44%7C40=23.72%7C43=10:8%7C%7C41=600%7C42=16:40:46%7C40=23.72%7C43=10:1618%7C%7C41=800%7C42=16:41:11%7C40=23.72%7C43=10:1618%7C%7C41=1000%7C42=16:41:11%7C40=23.72%7C43=10:3%7C%7C41=1000%7C42=16:41:16%7C40=23.72%7C43=10:1618%7C%7C41=2300%7C42=15:39:46%7C40=23.73%7C43=10:120%7C%7C41=1000%7C42=15:39:47%7C40=23.73%7C43=10:1618%7C%7C41=13... cut
    The first INCOMING DATA was never sent. It seems that albeit the signature mode being DISTINCT some optimization was applied and the first data was discarded. Is there a way to avoid this and make sure Lightstreamer send all data when the signature mode is DISTINCT?

    I've attached a grepped log but I can provide a more complete one if needed.

    Regards,
    Emerson
    Attached Files Attached Files

  2. #2
    Administrator
    Join Date
    Jul 2006
    Location
    Milan
    Posts
    1,090
    Hi,

    You can specify "unfiltered" in your subscription;
    otherwise some filtering is allowed by the interface contract and there are a few corner cases in which it can occur.
    Note that unfiltered only makes sense if the average update rate from the Data Adapter is low.

    To ascertain that the filtering was justified, we would like to see the details of the subscription operation.
    They can be collected by setting LightstreamerLogger.requests and LightstreamerLogger.subscriptions at DEBUG level.
    The best conditions are if you manage to reproduce the case on a dedicated Server instance;
    but it is enough that you can ensure that the involved client is the first one that subscribes to the involved item.

  3. #3
    Hi Dario,

    Sorry for the delay in this reply.

    We found it. The subscriptions were "filtered". We switch them to "unfiltered" and everything is working fine now.

    Thanks!

 

 

Similar Threads

  1. Basic Stock Demo in DISTINCT mode
    By Virendra in forum Adapter SDKs
    Replies: 1
    Last Post: May 20th, 2016, 10:38 AM
  2. Difference between DISTINCT and MERGE mode?
    By hungtt in forum General
    Replies: 1
    Last Post: January 4th, 2011, 01:07 PM
  3. Raw mode subscription, missing snapshot
    By Pradeep Chahal in forum Adapter SDKs
    Replies: 1
    Last Post: January 22nd, 2010, 02:57 PM
  4. DISTINCT updates are NULL with recent LS server
    By rsouissi in forum Client SDKs
    Replies: 4
    Last Post: March 6th, 2008, 02:59 PM
  5. Replies: 6
    Last Post: May 30th, 2007, 12:47 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
All times are GMT +1. The time now is 02:30 PM.