Sybase NNTP forums - End Of Life (EOL)

The NNTP forums from Sybase - forums.sybase.com - are now closed.

All new questions should be directed to the appropriate forum at the SAP Community Network (SCN).

Individual products have links to the respective forums on SCN, or you can go to SCN and search for your product in the search box (upper right corner) to find your specific developer center.

INPUT INTO performance - SLOOOWW

4 posts in General Discussion Last posting was on 2002-10-24 14:31:48.0Z
DanG Posted on 2002-10-23 12:35:14.0Z
From: DanG
Date: Wed, 23 Oct 2002 08:35:14 -0400
Newsgroups: ianywhere.public.general
Subject: INPUT INTO performance - SLOOOWW
Message-ID: <F6D275E56BE2584C004524F485256C5B.0045250D85256C5B@webforums>
Lines: 15
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Path: forums-1-dub!forums-master.sybase.com!forums.sybase.com!webforums.sybase.com!news
Xref: forums-1-dub ianywhere.public.general:504
Article PK: 2323

I am running ASA 8.0.1 and am using the Input Into From xxx.txt Format
ASCII Delimited By 'TAB'

The file I am importing has 12.5 million records and I am importing it into
an unindexed table. The ODBC connection is starting the DB with the
following options -b -c 700m

It processes about 1000 - 1500 records per second, which to me seems very
slow. I would guestimate that it will take 1.5 to 1.75 hours to load. I can
import this same file in MS SQL Server 2000 in less than 20 minutes. Is
there anything else in ASA that I have possibly not set that will help pick
up the pace?

Thanks,

Dan


Robert Waywell Posted on 2002-10-23 15:15:10.0Z
From: "Robert Waywell" <rwaywell@ianywhere.com>
References: <F6D275E56BE2584C004524F485256C5B.0045250D85256C5B@webforums>
Subject: Re: INPUT INTO performance - SLOOOWW
Date: Wed, 23 Oct 2002 11:15:10 -0400
Lines: 52
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 5.50.4522.1200
X-MimeOLE: Produced By Microsoft MimeOLE V5.50.4522.1200
Message-ID: <rTerakqeCHA.297@forums.sybase.com>
Newsgroups: ianywhere.public.general
NNTP-Posting-Host: 172.31.143.74
Path: forums-1-dub!forums-master.sybase.com!forums.sybase.com
Xref: forums-1-dub ianywhere.public.general:502
Article PK: 2321

Take a look at the LOAD TABLE statement as an alternative. This is an engine
side operation as opposed to an ISQL side operation which eliminates a layer
of communications overhead. It is also minimally logged which is another
speed benefit.

FYI - The forum sybase.public.sqlanywhere.general is more specifically
focused on ASA questions and is generally a better location to post ASA
specific questions to.
--
-----------------------------------------------
Robert Waywell
Sybase Adaptive Server Anywhere Developer - Version 8
Sybase Certified Professional

Sybase's iAnywhere Solutions

Please respond ONLY to newsgroup

EBF's and Patches: http://downloads.sybase.com
choose SQL Anywhere Studio >> change 'time frame' to all

To Submit Bug Reports: http://casexpress.sybase.com/cx/cx.stm

SQL Anywhere Studio Supported Platforms and Support Status
http://my.sybase.com/detail?id=1002288

Whitepapers, TechDocs, and bug fixes are all available through the iAnywhere
Developer Community at www.ianywhere.com/developer

<DanG> wrote in message
news:F6D275E56BE2584C004524F485256C5B.0045250D85256C5B@webforums...
> I am running ASA 8.0.1 and am using the Input Into From xxx.txt Format
> ASCII Delimited By 'TAB'
>
> The file I am importing has 12.5 million records and I am importing it
into
> an unindexed table. The ODBC connection is starting the DB with the
> following options -b -c 700m
>
> It processes about 1000 - 1500 records per second, which to me seems very
> slow. I would guestimate that it will take 1.5 to 1.75 hours to load. I
can
> import this same file in MS SQL Server 2000 in less than 20 minutes. Is
> there anything else in ASA that I have possibly not set that will help
pick
> up the pace?
>
> Thanks,
>
> Dan


DanG Posted on 2002-10-23 20:49:12.0Z
From: DanG
Date: Wed, 23 Oct 2002 16:49:12 -0400
Newsgroups: ianywhere.public.general
Subject: Re: INPUT INTO performance - SLOOOWW
Message-ID: <904AC3A2AF50C77400725E2085256C5B.0057E3E285256C5B@webforums>
References: <F6D275E56BE2584C004524F485256C5B.0045250D85256C5B@webforums> <rTerakqeCHA.297@forums.sybase.com>
Lines: 6
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: 7bit
Path: forums-1-dub!forums-master.sybase.com!forums.sybase.com!webforums.sybase.com!news
Xref: forums-1-dub ianywhere.public.general:500
Article PK: 2318

LOAD TABLE proved to have a significant improvement - 40 minutes to load
from almost 2 hours.

Thanks,

Dan


Robert Waywell Posted on 2002-10-24 14:31:48.0Z
From: "Robert Waywell" <rwaywell@ianywhere.com>
References: <F6D275E56BE2584C004524F485256C5B.0045250D85256C5B@webforums> <rTerakqeCHA.297@forums.sybase.com> <904AC3A2AF50C77400725E2085256C5B.0057E3E285256C5B@webforums>
Subject: Re: INPUT INTO performance - SLOOOWW
Date: Thu, 24 Oct 2002 10:31:48 -0400
Lines: 36
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 5.50.4522.1200
X-MimeOLE: Produced By Microsoft MimeOLE V5.50.4522.1200
Message-ID: <BhpQ3w2eCHA.248@forums.sybase.com>
Newsgroups: ianywhere.public.general
NNTP-Posting-Host: 172.31.143.74
Path: forums-1-dub!forums-master.sybase.com!forums.sybase.com
Xref: forums-1-dub ianywhere.public.general:496
Article PK: 2315

Is this LOAD statement causing the database to grow in size?
If so, and specifically since you are using 8.x, you may find it
beneficial to preallocate space in the database file. This can be done with
the ALTER DBSPACE statement. The main database file is the SYSTEM dbspace.

--
-----------------------------------------------
Robert Waywell
Sybase Adaptive Server Anywhere Developer - Version 8
Sybase Certified Professional

Sybase's iAnywhere Solutions

Please respond ONLY to newsgroup

EBF's and Patches: http://downloads.sybase.com
choose SQL Anywhere Studio >> change 'time frame' to all

To Submit Bug Reports: http://casexpress.sybase.com/cx/cx.stm

SQL Anywhere Studio Supported Platforms and Support Status
http://my.sybase.com/detail?id=1002288

Whitepapers, TechDocs, and bug fixes are all available through the iAnywhere
Developer Community at www.ianywhere.com/developer

<DanG> wrote in message
news:904AC3A2AF50C77400725E2085256C5B.0057E3E285256C5B@webforums...
> LOAD TABLE proved to have a significant improvement - 40 minutes to load
> from almost 2 hours.
>
> Thanks,
>
> Dan