Sybase NNTP forums - End Of Life (EOL)

The NNTP forums from Sybase - forums.sybase.com - are now closed.

All new questions should be directed to the appropriate forum at the SAP Community Network (SCN).

Individual products have links to the respective forums on SCN, or you can go to SCN and search for your product in the search box (upper right corner) to find your specific developer center.

PB 11.5 slow performance when filtering datawindow

5 posts in DataWindow Last posting was on 2009-09-24 12:17:28.0Z
Ontsnapt Posted on 2009-09-23 10:00:23.0Z
From: Ontsnapt <ontsnapt@hotmail.com>
User-Agent: Thunderbird 2.0.0.23 (Windows/20090812)
MIME-Version: 1.0
Newsgroups: sybase.public.powerbuilder.datawindow
Subject: PB 11.5 slow performance when filtering datawindow
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
NNTP-Posting-Host: vip152.sybase.com
X-Original-NNTP-Posting-Host: vip152.sybase.com
Message-ID: <4ab9f1b7@forums-1-dub>
Date: 23 Sep 2009 03:00:23 -0700
X-Trace: forums-1-dub 1253700023 10.22.241.152 (23 Sep 2009 03:00:23 -0700)
X-Original-Trace: 23 Sep 2009 03:00:23 -0700, vip152.sybase.com
Lines: 14
Path: forums-1-dub!not-for-mail
Xref: forums-1-dub sybase.public.powerbuilder.datawindow:89984
Article PK: 419171

In our C/S application we retrieve 1.400.000 rows in a grid datawindow.
Retrieval time is about 2 minutes. However filtering the data takes at
least 8 minutes.

Is there a way to increase performance for filtering the data?

Retrieving less rows is not an option since our clients want to have the
detailed information available.

Machine details: Windows Vista, Quad CPU 2.4Ghz, 3Gb, 32 bits.

Thanks
Eric


Jeremy Lakeman Posted on 2009-09-23 14:17:15.0Z
From: Jeremy Lakeman <jeremy.lakeman@gmail.com>
Newsgroups: sybase.public.powerbuilder.datawindow
Subject: Re: PB 11.5 slow performance when filtering datawindow
Date: Wed, 23 Sep 2009 07:17:15 -0700 (PDT)
Organization: http://groups.google.com
Lines: 27
Message-ID: <771eef2f-69b2-4fbc-bfb9-1f3a85df1475@b25g2000prb.googlegroups.com>
References: <4ab9f1b7@forums-1-dub>
NNTP-Posting-Host: 122.49.161.51
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
X-Trace: posting.google.com 1253715435 5940 127.0.0.1 (23 Sep 2009 14:17:15 GMT)
X-Complaints-To: groups-abuse@google.com
NNTP-Posting-Date: Wed, 23 Sep 2009 14:17:15 +0000 (UTC)
Complaints-To: groups-abuse@google.com
Injection-Info: b25g2000prb.googlegroups.com; posting-host=122.49.161.51; posting-account=euaBtgoAAAC_vDxfsxmpMKlBxHaHpmRS
User-Agent: G2/1.0
X-HTTP-UserAgent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-GB; rv:1.9.1.3) Gecko/20090824 Firefox/3.5.3 (.NET CLR 3.5.30729),gzip(gfe),gzip(gfe)
Path: forums-1-dub!forums-master!newssvr.sybase.com!news-sj-1.sprintlink.net!news-peer1.sprintlink.net!newsfeed.yul.equant.net!novia!news-out.readnews.com!news-xxxfer.readnews.com!postnews.google.com!b25g2000prb.googlegroups.com!not-for-mail
Xref: forums-1-dub sybase.public.powerbuilder.datawindow:89986
Article PK: 419173


On Sep 23, 7:00 pm, Ontsnapt <ontsn...@hotmail.com> wrote:
> In our C/S application we retrieve 1.400.000 rows in a grid datawindow.
> Retrieval time is about 2 minutes. However filtering the data takes at
> least 8 minutes.
>
> Is there a way to increase performance for filtering the data?
>
> Retrieving less rows is not an option since our clients want to have the
> detailed information available.
>
> Machine details: Windows Vista, Quad CPU 2.4Ghz, 3Gb, 32 bits.
>
> Thanks
> Eric

How can the user possibly view 1.4M rows at the same time?

I'd suggest you work out exactly what their use cases are and find a
way to pretend that you have all 1.4M rows but only retrieve what the
user is actually looking at for any point in time. Or retrieve the
records as you write them out to a file when requested.

There's a big difference between having the information "available" in
memory and loading it on demand only when you really, really have to.

On the plus side it should be faster to leave all the searching /
sorting / filtering / aggregating work to run in the database.


Ontsnapt Posted on 2009-09-24 05:29:35.0Z
From: ontsnapt <ontsnapt@hotmail.com>
User-Agent: Thunderbird 2.0.0.23 (Windows/20090812)
MIME-Version: 1.0
Newsgroups: sybase.public.powerbuilder.datawindow
Subject: Re: PB 11.5 slow performance when filtering datawindow
References: <4ab9f1b7@forums-1-dub> <771eef2f-69b2-4fbc-bfb9-1f3a85df1475@b25g2000prb.googlegroups.com>
In-Reply-To: <771eef2f-69b2-4fbc-bfb9-1f3a85df1475@b25g2000prb.googlegroups.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
NNTP-Posting-Host: vip152.sybase.com
X-Original-NNTP-Posting-Host: vip152.sybase.com
Message-ID: <4abb03bf$1@forums-1-dub>
Date: 23 Sep 2009 22:29:35 -0700
X-Trace: forums-1-dub 1253770175 10.22.241.152 (23 Sep 2009 22:29:35 -0700)
X-Original-Trace: 23 Sep 2009 22:29:35 -0700, vip152.sybase.com
Lines: 41
Path: forums-1-dub!not-for-mail
Xref: forums-1-dub sybase.public.powerbuilder.datawindow:89994
Article PK: 419181

Hello Jeremy,

Thanks for the answer. I think what you are trying to tell me is that
powerbuilder is not the tool to go for in case you want to "play" with
this amount of data.

I really had hoped someone had found a way to increase speed of
filtering if saving the data is not necessary. This would give us great
options.

Thanks
Eric

Jeremy Lakeman wrote:
> On Sep 23, 7:00 pm, Ontsnapt <ontsn...@hotmail.com> wrote:
>> In our C/S application we retrieve 1.400.000 rows in a grid datawindow.
>> Retrieval time is about 2 minutes. However filtering the data takes at
>> least 8 minutes.
>>
>> Is there a way to increase performance for filtering the data?
>>
>> Retrieving less rows is not an option since our clients want to have the
>> detailed information available.
>>
>> Machine details: Windows Vista, Quad CPU 2.4Ghz, 3Gb, 32 bits.
>>
>> Thanks
>> Eric
>
> How can the user possibly view 1.4M rows at the same time?
>
> I'd suggest you work out exactly what their use cases are and find a
> way to pretend that you have all 1.4M rows but only retrieve what the
> user is actually looking at for any point in time. Or retrieve the
> records as you write them out to a file when requested.
>
> There's a big difference between having the information "available" in
> memory and loading it on demand only when you really, really have to.
>
> On the plus side it should be faster to leave all the searching /
> sorting / filtering / aggregating work to run in the database.


Jeremy Lakeman Posted on 2009-09-24 07:30:38.0Z
From: Jeremy Lakeman <jeremy.lakeman@gmail.com>
Newsgroups: sybase.public.powerbuilder.datawindow
Subject: Re: PB 11.5 slow performance when filtering datawindow
Date: Thu, 24 Sep 2009 00:30:38 -0700 (PDT)
Organization: http://groups.google.com
Lines: 49
Message-ID: <49974127-87ab-4d6f-8c95-810737b76fe1@d23g2000vbm.googlegroups.com>
References: <4ab9f1b7@forums-1-dub> <771eef2f-69b2-4fbc-bfb9-1f3a85df1475@b25g2000prb.googlegroups.com> <4abb03bf$1@forums-1-dub>
NNTP-Posting-Host: 203.122.242.105
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
X-Trace: posting.google.com 1253777439 7049 127.0.0.1 (24 Sep 2009 07:30:39 GMT)
X-Complaints-To: groups-abuse@google.com
NNTP-Posting-Date: Thu, 24 Sep 2009 07:30:39 +0000 (UTC)
Complaints-To: groups-abuse@google.com
Injection-Info: d23g2000vbm.googlegroups.com; posting-host=203.122.242.105; posting-account=euaBtgoAAAC_vDxfsxmpMKlBxHaHpmRS
User-Agent: G2/1.0
X-HTTP-Via: 1.1 fly.essential.com.au:3128 (squid/2.5.STABLE8), 1.0 asp.essential.intranet:3128 (squid/2.5.STABLE8)
X-HTTP-UserAgent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.3) Gecko/20090824 Firefox/3.5.3 (.NET CLR 3.5.30729),gzip(gfe),gzip(gfe)
Path: forums-1-dub!forums-master!newssvr.sybase.com!news-sj-1.sprintlink.net!news-peer1.sprintlink.net!newsfeed.yul.equant.net!novia!news-out.readnews.com!transit3.readnews.com!postnews.google.com!d23g2000vbm.googlegroups.com!not-for-mail
Xref: forums-1-dub sybase.public.powerbuilder.datawindow:89995
Article PK: 419182


On Sep 24, 2:29 pm, ontsnapt <ontsn...@hotmail.com> wrote:
> Hello Jeremy,
>
> Thanks for the answer. I think what you are trying to tell me is that
> powerbuilder is not the tool to go for in case you want to "play" with
> this amount of data.
>
> I really had hoped someone had found a way to increase speed of
> filtering if saving the data is not necessary. This would give us great
> options.
>
> Thanks
> Eric
>
> Jeremy Lakeman wrote:
> > On Sep 23, 7:00 pm, Ontsnapt <ontsn...@hotmail.com> wrote:
> >> In our C/S application we retrieve 1.400.000 rows in a grid datawindow.
> >> Retrieval time is about 2 minutes. However filtering the data takes at
> >> least 8 minutes.
>
> >> Is there a way to increase performance for filtering the data?
>
> >> Retrieving less rows is not an option since our clients want to have the
> >> detailed information available.
>
> >> Machine details: Windows Vista, Quad CPU 2.4Ghz, 3Gb, 32 bits.
>
> >> Thanks
> >> Eric
>
> > How can the user possibly view 1.4M rows at the same time?
>
> > I'd suggest you work out exactly what their use cases are and find a
> > way to pretend that you have all 1.4M rows but only retrieve what the
> > user is actually looking at for any point in time. Or retrieve the
> > records as you write them out to a file when requested.
>
> > There's a big difference between having the information "available" in
> > memory and loading it on demand only when you really, really have to.
>
> > On the plus side it should be faster to leave all the searching /
> > sorting / filtering / aggregating work to run in the database.

Part of the problem with filtering is the need to evaluate an
expression on every row.
If you can identify a group of rows you want to exclude in another way
you could call rowsmove to filter a block of records in one hit.


Scott Morris Posted on 2009-09-24 12:17:28.0Z
From: "Scott Morris" <bogus@bogus.com>
Newsgroups: sybase.public.powerbuilder.datawindow
References: <4ab9f1b7@forums-1-dub> <771eef2f-69b2-4fbc-bfb9-1f3a85df1475@b25g2000prb.googlegroups.com> <4abb03bf$1@forums-1-dub>
Subject: Re: PB 11.5 slow performance when filtering datawindow
Lines: 18
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2900.5843
X-RFC2646: Format=Flowed; Response
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.5579
NNTP-Posting-Host: vip152.sybase.com
X-Original-NNTP-Posting-Host: vip152.sybase.com
Message-ID: <4abb6358$1@forums-1-dub>
Date: 24 Sep 2009 05:17:28 -0700
X-Trace: forums-1-dub 1253794648 10.22.241.152 (24 Sep 2009 05:17:28 -0700)
X-Original-Trace: 24 Sep 2009 05:17:28 -0700, vip152.sybase.com
Path: forums-1-dub!not-for-mail
Xref: forums-1-dub sybase.public.powerbuilder.datawindow:89997
Article PK: 419186


"ontsnapt" <ontsnapt@hotmail.com> wrote in message
news:4abb03bf$1@forums-1-dub...
> Hello Jeremy,
>
> Thanks for the answer. I think what you are trying to tell me is that
> powerbuilder is not the tool to go for in case you want to "play" with
> this amount of data.
>
> I really had hoped someone had found a way to increase speed of filtering
> if saving the data is not necessary. This would give us great options.

If a complete retrieve takes 2 minutes, it would be faster to simply
re-retrieve the datawindow after modifying the query. I'll agree that it is
unrealistic for any standard query tool to function efficiently with
hundreds of thousands of rows Perhaps your dbms vendor has OLAP tools that
are more suitable for this type of thing.