Page 1 of 2 12 LastLast
Results 1 to 10 of 17
  1. #1
    Senior Member
    Join Date
    Oct 2007
    Location
    HoChiMinh
    Posts
    69

    Could you explain more about _stockGenerators, _snapshotQueue, _snapshotSender?

    Could you explain more about _stockGenerators, _snapshotQueue, _snapshotSender in StockList demo code?

    In "ExternalFeed.cs" file, StockListDemo code (mark by red color) :

    public ExternalFeed() {

    _stockGenerators= new Hashtable();
    _snapshotQueue= new ArrayList();
    ...
    }

    public void Start() {
    if (_snapshotSender != null) return;

    for (int i = 0; i < 30; i++) --> purpose of for statement? Why it loop from 1 to 30?
    {
    string itemName= "item" + (i + 1);
    ...

    _stockGenerators[itemName]= myProducer;
    myProducer.SetFeedListener(_listener);
    myProducer.Start();
    }
    _snapshotSender= new Thread(new ThreadStart(Run)); --> I don't understand
    _snapshotSender.Start();
    }

    private void Run() {
    IList snapshots= new ArrayList();
    do {
    lock (_snapshotQueue) {
    if (_snapshotQueue.Count == 0)
    Monitor.Wait(_snapshotQueue);

    snapshots.Clear();
    while (_snapshotQueue.Count > 0) {
    ExternalFeedProducer myProducer= (ExternalFeedProducer) _snapshotQueue[0];
    snapshots.Add(myProducer);
    _snapshotQueue.RemoveAt(0);
    } }

    foreach (ExternalFeedProducer myProducer in snapshots) {
    _listener.OnEvent(myProducer.GetItemName(), myProducer.GetCurrentValues(true), true);
    }

    } while (true);

    }

  2. #2
    Administrator
    Join Date
    Jul 2006
    Location
    Milan
    Posts
    1,090
    This sample class "simulates" a broadcast feed, which is one of the most common types of data feed, especially in a trading scenario.
    Once you connect to such a feed, you immediately receive the current real-time update flow for all available data (the IExternalFeedListener interface).
    Some broacast feed may also allow you to request the current state of a data item. Our sample feed class does support this (the SendCurrentValues method).

    In our sample feed class, all available data consists of 30 fake stocks, which is what is needed by the StockList demo front-end. For each of the above stocks/items, we create a specific object, of type ExternalFeedProducer, whose job is to create a thread and generate the updates for the item. We collect all these objects in the _stockGenerators hash table.

    In order to manage SendCurrentValues request, the feed does not return the current state to the caller, but it rather sends a redundant event to the IExternalFeedListener interface (i.e. an event which does not carry updated data but just the current state). We do this in a separate thread (we call this thread _snapshotSender; it runs the Run method reported above) and use the _snapshotQueue queue to send the SendCurrentValues requests to that thread.

    Hope This Helps
    Dario

  3. #3
    Senior Member
    Join Date
    Oct 2007
    Location
    HoChiMinh
    Posts
    69
    Hi Dario,
    You mean, StockListDemo work-flow :
    Step 1: Get feed data (simulate) from "ExternalFeed" class

    public ExternalFeedSimulator() {
    _stockGenerators= new Hashtable();
    _snapshotQueue= new ArrayList();
    ...
    }

    Step 2 : Starts generating update events for the stocks. attaching and reading from an external broadcast feed (in step 1).

    public void Start()
    {
    if (_snapshotSender != null) return;
    //all available data consists of 30 fake stocks, which is what is needed by the StockList demo front-end.
    for (int i = 0; i < 30; i++)
    {
    ....
    //For each of the above stocks/items, you create a specific object, of type ExternalFeedProducer, whose job is to create a thread and generate the updates for the item.
    ExternalFeedProducer myProducer = new ExternalFeedProducer(itemName,
    _openprices[i], _refprices[i], _minprices[i], _maxprices[i],
    _updateTimeMeans[i], _updateTimeStdDevs[i], _stockNames[i]);

    _stockGenerators[itemName]= myProducer;
    myProducer.SetFeedListener(_listener);
    myProducer.Start();
    }
    ...
    }


    private void Run()
    {
    ...
    }


    Now, I want to call my function every 5 seconds, it starts generating update events for the stocks, attaching and reading from an external broadcast feed (in step 1). How do I do?

    Can u help me?

  4. #4
    Administrator
    Join Date
    Jul 2006
    Location
    Milan
    Posts
    1,090
    Provided that you still think that the demo architecture fits your needs, in order to send your custom data, you should customize only the "ExternalFeedProducer" class.
    Each object instance of this class owns an update thread, which waits for randomly generated times, produced by the "ComputeNextWaitTime" method; you can rewrite the latter to always return 5000 milliseconds.
    Then, you should only rewrite the "ComputeNewValues" and "GetCurrentValues" methods. The first one produces new data for the instance-related stock and stores it in the object; the second one collects the stored data in an "IDictionary", suitable for being sent forward.

    If, however, you can only read data for all your stocks, from outside, as an atomic operation, then some adjustments would be needed (it is still unclear to me which are your requirements).

    Dario

  5. #5
    Senior Member
    Join Date
    Oct 2007
    Location
    HoChiMinh
    Posts
    69
    Hi Dario,
    I tried follow your instruction, but it has error : Out of memory.

    Here my changed
    -------

    public int ComputeNextWaitTime()
    {
    lock (this)
    {
    return 5000;
    }
    }

    public void ComputeNewValues()
    {
    ISecurityStructReader reader;
    reader = new ReadSecurityStruct("C:\\TEMP\\BACKUP14\\SECURITY.D AT");

    nStock = 0;

    if (reader.Open())
    {
    arr = reader.Read();

    nStock = arr.Count;

    _stockSymbol = new string[nStock];

    for (int i=0; i< nStock ;i++)
    {
    Struct_Security item = (Struct_Security)arr[i];
    //_stockNames.Add(item.SecurityName);
    _openprices[i]= item.OpenPrice;
    _stockSymbol[i]= item.StockSymbol;
    ...

    string itemName= "item" + (i + 1);
    ExternalFeedProducer myProducer = new ExternalFeedProducer(itemName, m_openprices[i], m_refprices[i], m_minprices[i], m_maxprices[i], m_stockSymbol[i], m_stockNames[i], m_ceiling[i], m_floor[i], m_bid1[i], m_bid2[i], m_bid3[i], m_bid1vol[i], m_bid2vol[i], m_bid3vol[i], m_ask1[i], m_ask2[i], m_ask3[i],m_ask1vol[1], m_ask2vol[i], m_ask3vol[i], m_last[i], m_lastVal[i], m_lastVol[i], m_projectOpen[i]);

    _stockGenerators[itemName]= myProducer;

    myProducer.SetFeedListener(_listener);
    myProducer.Start();
    }
    ...
    }

    }

    -----------
    My step is correct?

    In my case, stock data i get from outside and it is a binary file and has a structure. I read it and store it in array list.

    In your code, u stored data in an "IDictionay" because you change only 01 value of item in the same time, but my data has many change in many item (in the same time).

    Example :
    10:00 AM I have :
    stock_symbol[1] = STB , price[1] = 100, volume[1] = 99
    stock_symbol[2]= ACB, price[2] = 80, volume[2] = 89

    10:01 AM, I have
    stock_symbol[1] = STB , price[1] = 101, volume[1] = 90
    stock_symbol[2]= ACB, price[2] = 82, volume[2] = 80

    How to rewrite "GetCurrentValues" and "ComputeNewValues" to store this? Can u help me?

  6. #6
    Administrator
    Join Date
    Jul 2006
    Location
    Milan
    Posts
    1,090
    I assume from the above that the answer to my doubt
    If, however, you can only read data for all your stocks, from outside, as an atomic operation, then some adjustments would be needed (it is still unclear to me which are your requirements).
    is yes; you can only read updates for several or all stocks alltogether from a file. Then I'm afraid that the demo Data Adapter architecture is not suitable for you as a starting point.

    What do you exactly read from your files?
    Do you get values for all stocks or only for the modified stocks?
    And, for each stock read, do you get values for all fields or only for the modified fields?

    Dario

  7. #7
    Senior Member
    Join Date
    Oct 2007
    Location
    HoChiMinh
    Posts
    69
    Dear Dario,
    Let's me explain : Stock Exchange send data file (binary file) to the Broker company, this file has information for all stocks (stock symbol, stock name, price, volume, ceiling, floor, percent change,...). If some stock has information changed, they send this file again to the Broker company. So every 5-10 seconds, I need read this file again to get values for all stocks, because i don't know which stock modified.

    Exactly I need to read from file :
    - Get values for all stocks : stock symbol, stock name, stock type (bond or common stock) ceiling price, floor price, open price, split (means stock has divident or not), benifit (means stock has action coporation), prior Close price, last price, last volume, last values, percent change, highest price, lowest price, Best 1 bid, Best 1 bid volume, Best 2 bid, Best 2 bid volume, Best 3 bid, Best 3 bid volume, Best 1 Offer, Best 1 Offer volume, Best 2 Offer, Best 2 Offer volume, Best 3 Offer, Best 3 Offer volume.

    for each stock read, I want to get values for all fields :
    -------
    last price, last volume, last values, percent change, highest price, lowest price, Best 1 bid, Best 1 bid volume, Best 2 bid, Best 2 bid volume, Best 3 bid, Best 3 bid volume, Best 1 Offer, Best 1 Offer volume, Best 2 Offer, Best 2 Offer volume, Best 3 Offer, Best 3 Offer volume

    Here struct binary file, it has contain 504 stocks :
    --------
    [StructLayout(LayoutKind.Sequential, Pack = 1)]
    public struct Struct_Security
    {
    //221: SECURITY.DAT
    //Ma CK dang so (2 bytes)
    public short StockNo;

    //Ma CK dang chuoi (8 bytes)
    [MarshalAs(UnmanagedType.ByValTStr, SizeConst =8)]
    public string StockSymbol;

    //Loai CK (S:Co phieu, D:Trai phieu, U:Chung chi quy) (1 byte)
    [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 1)]
    public string StockType;

    //Gia tran (4 bytes)
    public int Ceiling;
    //Gia san (4 bytes)
    public int Floor;

    //
    public double BigLotValue;


    //Ten day du cua CK
    [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 25)]
    public string SecurityName;

    [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 1)]
    public string SectorNo;

    [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 1)]
    //
    public string Designated;

    [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 1)]
    //CK bi ngung GD (Null: GD binh thuong, S: Bi ngung GD)
    public string Suspension;

    [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 1)]
    public string Delist;
    [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 1)]
    public string HaltResumeFlag;
    [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 1)]
    public string Split;
    [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 1)]
    public string Benefit;
    [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 1)]
    public string Meeting;
    [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 1)]
    public string Notice;

    [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 1)]
    public string ClientIDRequired;
    public short CouponRate;

    [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 6)]
    public string IssueDate;

    [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 6)]
    public string MatureDate;

    public int AvrPrice;

    public short ParValue;

    [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 1)]
    public string SDCFlag;

    public int PriorClosePrice;

    [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 6)]
    public string PriorCloseDate;

    public int ProjectOpen;

    public int OpenPrice;
    public int Last;
    public int LastVol;
    public double LastVal;
    public int Highest;
    public int Lowest;

    public double Totalshares;
    public double TotalValue;
    public short AccumulateDeal;
    public short BigDeal;
    public int BigVol;
    public double BigVal;
    public short OddDeal;
    public int OddVol;
    public double OddVal;

    //Single
    public int Best1Bid;
    public int Best1BidVolume;
    //Single
    public int Best2Bid;
    public int Best2BidVolume;
    //Single
    public int Best3Bid;
    public int Best3BidVolume;

    //Single
    public int Best1Offer;
    public int Best1OfferVolume;
    //Single
    public int Best2Offer;
    public int Best2OfferVolume;
    //Single
    public int Best3Offer;
    public int Best3OfferVolume;

    public short BoardLost;

    public static System.Collections.ArrayList ReaderBlock2Array(BinaryReader br)
    {
    System.Collections.ArrayList arr = new System.Collections.ArrayList();

    br.BaseStream.Position = 0;
    while (br.BaseStream.Position < br.BaseStream.Length)
    {
    byte[] buff = br.ReadBytes(TSSize.Size);
    GCHandle handle = GCHandle.Alloc(buff, GCHandleType.Pinned);
    Struct_Security s = (Struct_Security)Marshal.PtrToStructure(handle.Add rOfPinnedObject(), typeof(Struct_Security));

    handle.Free();
    arr.Add(s);
    }

    return arr;
    }
    }

    internal sealed class TSSize
    {
    public static int _size;

    static TSSize()
    {
    _size = Marshal.SizeOf(typeof(Struct_Security));

    }

    public static int Size
    {
    get
    {
    return _size;
    }
    }
    }


    Can u help me?

  8. #8
    Administrator
    Join Date
    Jul 2006
    Location
    Milan
    Posts
    1,090
    You should definitely rewrite the ExternalFeedSimulator class and get rid of the included ExternalFeedProducer class.
    The Data Adapter should receive all data and detect the changed data in order to send them to Lightstreamer.

    However, to keep the Data Adapter simple for demo purpose, the Data Adapter can also forward all data to Lightstreamer, which will be responsible for detecting the changed data and only send them to the client. Please consider that this is not recommended in a production scenario.
    The simplest structure might be:

    Code:
    constructor:
       create a map to hold all snapshots
          (let's create an IDictionary and call it _snaps)
    
    method Start:
       start a new thread with the following behaviour:
          every 5 seconds:
             read the file
             for each stock:
                create an IDictionary to store all field name/value pairs
                associate the IDictionary to the stock name in _snaps
                   (the previous association, if any, should be garbage collected)
                call onEvent on the listener and send the IDictionary 
    
    method SendCurrentValues:
       get the IDictionary associated to the requested item name in _snap
       if found:
          call onEvent on the listener and send the IDictionary
       else
          call onEvent on the listener with an empty IDictionary

  9. #9
    Senior Member
    Join Date
    Oct 2007
    Location
    HoChiMinh
    Posts
    69
    Dear Dario,
    Thanks for your help, I tried follow by your instruction, but after every 5 second when the data file changed, the Data Adapter didn't receive all data and detect the changed data in order to send them to Lightstreamer. i don't know what are my fault? Can u help me?

    Here my changed :
    --- "ExternalFeed.cs" file, ExternalFeedSimulator class ----

    constructor :
    ---

    private IDictionary _stockGenerators;

    public ExternalFeedSimulator {

    //create an IDictionary
    _stockGenerators= new Hashtable();

    ISecurityStructReader reader;
    reader = new ReadSecurityStruct("C:\\TEMP\\BACKUP14\\SECURITY.D AT");

    nStock = 0;

    if (reader.Open())
    {
    arr = reader.Read();
    nStock = arr.Count;

    m_stockSymbol = new string[nStock];
    m_openprices = new double[nStock];
    m_stockNames = new string[nStock];
    ...

    for (int i=0; i< nStock ;i++)
    {
    Struct_Security item = (Struct_Security)arr[i];
    m_openprices[i]= item.OpenPrice;
    ...
    }
    }
    reader.Close();
    }


    public void Start()
    {
    //Start a new thread
    lock (this)
    {
    if (_snapshotSender != null) return;

    _snapshotSender = new Thread(new ThreadStart(Run));
    _snapshotSender.Start();
    }
    }


    public void Run()
    {
    do
    {
    //every 5 seconds
    int waitMillis= ComputeNextWaitTime();
    Thread.Sleep(waitMillis);

    //read the file ReadBinaryFile();

    //for each stock for (int i=0; i<= nStock; i++)
    {
    //create an IDictionary to store all field name/value pairs associate the IDictionary to the stock name in _snaps
    string itemName= "item" + (i + 1);
    ExternalFeedProducer myProducer = new ExternalFeedProducer(itemName, m_openprices[i], m_refprices[i], m_minprices[i], m_maxprices[i], m_stockSymbol[i], m_stockNames[i], m_ceiling[i], m_floor[i], m_bid1[i], m_bid2[i], m_bid3[i], m_bid1vol[i], m_bid2vol[i], m_bid3vol[i], m_ask1[i], m_ask2[i], m_ask3[i], m_ask1vol[1], m_ask2vol[i], m_ask3vol[i], m_last[i], m_lastVal[i], m_lastVol[i], m_projectOpen[i]);

    _stockGenerators[itemName]= myProducer;

    //call onEvent on the listener and send the IDictionary
    _listener.OnEvent(myProducer.GetItemName(), myProducer.GetCurrentValues(true), true);

    }

    } while (true);
    }


    public int ComputeNextWaitTime()
    {
    lock (this)
    {
    return 5000;
    }
    }


    public void SendCurrentValues(string itemName)
    {
    //get the IDictionary associated to the requested item name in _snap
    ExternalFeedProducer myProducer= (ExternalFeedProducer) _stockGenerators[itemName];

    //call onEvent on the listener with an empty IDictionary, if not found.
    if (myProducer == null) return;

    //if found, call onEvent on the listener and send the IDictionary
    _listener.OnEvent(myProducer.GetItemName(), myProducer.GetCurrentValues(true), true);

    }

  10. #10
    Administrator
    Join Date
    Jul 2006
    Location
    Milan
    Posts
    1,090
    The code seems correct,
    provided that "ReadBinaryFile" populates your "m_" arrays in the same way as the constructor does
    and that "GetCurrentValues" generates an IDictionary.
    Any unwanted behaviour (for instance, the Data Adapter not receiving all read data) should be inspected with a debugger.
    Note that only Lightstreamer Server can check for unchanged data. This means that your Remote Adapter would still forward all updates to Lightstreamer Server.
    Dario

 

 

Similar Threads

  1. Replies: 8
    Last Post: May 7th, 2008, 10:53 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
All times are GMT +1. The time now is 02:59 PM.