Sybase NNTP forums - End Of Life (EOL)

The NNTP forums from Sybase - forums.sybase.com - are now closed.

All new questions should be directed to the appropriate forum at the SAP Community Network (SCN).

Individual products have links to the respective forums on SCN, or you can go to SCN and search for your product in the search box (upper right corner) to find your specific developer center.

SQl Anywhere database log tools

4 posts in General Discussion Last posting was on 2008-08-05 16:36:22.0Z
rpruski Posted on 2008-07-15 02:24:55.0Z
Sender: 190c.487c0a21.1804289383@sybase.com
From: rpruski@esc20.net
Newsgroups: ianywhere.public.general
Subject: SQl Anywhere database log tools
X-Mailer: WebNews to Mail Gateway v1.1t
Message-ID: <487c0a77.1919.1681692777@sybase.com>
NNTP-Posting-Host: 10.22.241.41
X-Original-NNTP-Posting-Host: 10.22.241.41
Date: 14 Jul 2008 19:24:55 -0700
X-Trace: forums-1-dub 1216088695 10.22.241.41 (14 Jul 2008 19:24:55 -0700)
X-Original-Trace: 14 Jul 2008 19:24:55 -0700, 10.22.241.41
Lines: 24
Path: forums-1-dub!not-for-mail
Xref: forums-1-dub ianywhere.public.general:6971
Article PK: 5196

First question, I've been given me the task to find a tool
for SQL Anywhere that is similar to Oracle's LogMiner.
Logminer easily locate database changes, enables data
analysis, and provides undo capabilities to rollback logical
data. We currently use SQL Anywhere with our client-server
Powerbuilder application, abut will be converting over to
JAVA. Previously we would translate a database log to SQL
to find changes within the database which is very tedious.
Our mainframe group uses a Oracle database and Logminer to
analyze or manipulate the database, which is the reason for
asking if there is a similar tool for SQL Anywhere.

Second question, are there any "white papers" or information
on the limits, performance impact of not using SQL Anywhere
driver pooling? Our management team would rather not use
pooling and have individual signons instead of a single
signon for a web application. Mainly to be able to have an
audit trail within the database log for accountability if
necessary, what would performance ramifications be on a web
application with 200 individuals logging in without pooling?

Thanks,

Robert


"Nick Elson" < Posted on 2008-07-15 22:01:27.0Z
From: "Nick Elson" <@@@nick@@@.@@@elson@sybase@@@.@@@com@@@>
Newsgroups: ianywhere.public.general
References: <487c0a77.1919.1681692777@sybase.com>
Subject: Re: SQl Anywhere database log tools
Lines: 49
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2900.2869
X-RFC2646: Format=Flowed; Original
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2962
NNTP-Posting-Host: vip152.sybase.com
X-Original-NNTP-Posting-Host: vip152.sybase.com
Message-ID: <487d1e37$1@forums-1-dub>
Date: 15 Jul 2008 15:01:27 -0700
X-Trace: forums-1-dub 1216159287 10.22.241.152 (15 Jul 2008 15:01:27 -0700)
X-Original-Trace: 15 Jul 2008 15:01:27 -0700, vip152.sybase.com
X-Authenticated-User: techsupp
Path: forums-1-dub!not-for-mail
Xref: forums-1-dub ianywhere.public.general:6972
Article PK: 5197

On the pooling question, to use or not to use pooling is
often a question of how often you are cycling connections.
If you connect infrequently, there may be no overall
performance benefit to pooling. Of course, there is no
better approach than to do some of your own testing
to get a measure on the real gains/overhead involved.

In part of your second question you mentioned something
that made me think of auditing.


I am not familiar with LogMiner. Maybe a few
more details about that utility's capabilities and
more importantly the need that is being used for
can help others respond.

You might find that some of the capabilities are
available from the cmdline. The dbtran utility
has quite a few switches to filter the log by.

<rpruski@esc20.net> wrote in message
news:487c0a77.1919.1681692777@sybase.com...
> First question, I've been given me the task to find a tool
> for SQL Anywhere that is similar to Oracle's LogMiner.
> Logminer easily locate database changes, enables data
> analysis, and provides undo capabilities to rollback logical
> data. We currently use SQL Anywhere with our client-server
> Powerbuilder application, abut will be converting over to
> JAVA. Previously we would translate a database log to SQL
> to find changes within the database which is very tedious.
> Our mainframe group uses a Oracle database and Logminer to
> analyze or manipulate the database, which is the reason for
> asking if there is a similar tool for SQL Anywhere.
>
> Second question, are there any "white papers" or information
> on the limits, performance impact of not using SQL Anywhere
> driver pooling? Our management team would rather not use
> pooling and have individual signons instead of a single
> signon for a web application. Mainly to be able to have an
> audit trail within the database log for accountability if
> necessary, what would performance ramifications be on a web
> application with 200 individuals logging in without pooling?
>
> Thanks,
>
> Robert


Robert Posted on 2008-07-29 19:31:11.0Z
From: "Robert" <robert.pruski@esc20.net>
Newsgroups: ianywhere.public.general
References: <487c0a77.1919.1681692777@sybase.com> <487d1e37$1@forums-1-dub>
Subject: Re: SQl Anywhere database log tools
Lines: 105
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2900.5512
X-RFC2646: Format=Flowed; Response
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.5512
NNTP-Posting-Host: vip152.sybase.com
X-Original-NNTP-Posting-Host: vip152.sybase.com
Message-ID: <488f6fff$1@forums-1-dub>
Date: 29 Jul 2008 12:31:11 -0700
X-Trace: forums-1-dub 1217359871 10.22.241.152 (29 Jul 2008 12:31:11 -0700)
X-Original-Trace: 29 Jul 2008 12:31:11 -0700, vip152.sybase.com
Path: forums-1-dub!not-for-mail
Xref: forums-1-dub ianywhere.public.general:6986
Article PK: 5211

Here is an overview of Logminer from Oracle's web site.
LogMinerT is a powerful audit tool for Oracle databases, allowing
administrators to easily locate changes in the database, enabling
sophisticated data analyses, and providing undo capabilities to rollback
logical data corruptions or user errors.

LogMiner offers two interfaces:

a.. A SQL interface, which calls built-in PL/SQL packages to setup a data
dictionary, specify redo logs, and execute queries (this interface is
applicable to SQL*Plus, command-line scripts, or custom applications).
b.. LogMiner Viewer, an intuitive GUI which allows the administrator to
setup a data dictionary, specify the redo logs, specify query criteria, and
view/save redo log data.
LogMiner can also be leveraged for:

a.. Ex post facto auditing of DML statements, the order in which
transactions were committed and the user responsible for the updates.
b.. Historical analysis of data access patterns for database tuning and
capacity planning.
c.. Tracking schema evolution and the impact on data structure.
LogMiner directly accesses the Oracle redo logs, which are complete records
of all activities performed on the database, and the associated data
dictionary, which is used to translate internal object identifiers and types
to external names and data formats. Using a dynamic view V$LOGMNR_CONTENTS,
LogMiner populates a row in this view with each logical operation performed
on the database, thus offering familiar, relational-based access for ad-hoc
querying or custom application consumption. Each row contains a SQL UNDO
statement, which can be used to rollback the change, and SQL REDO statement,
which details the original operation. Log analysis can be conducted with the
online catalog as the dictionary source, or an offline dictionary that has
been extracted to a set of relevant redo logs, or a standalone flat file.
With offline analysis, LogMiner can be run on a separate database, using
archived redo logs and the associated dictionary from the source database,
thus alleviating resource consumption on the source system.

Basically our mainframe staff can see data changes before and after from the
database log file. The question was raised if SQL Anywhere had a similar
tool where you could see a before view of the data, not just data contained
in a insert command for example. We use Sybase Central to translate a log
file into SQL which makes tracking changes difficult.

On the pooling question we will have many as little as 25 or up to 1500
users hitting multiple sites. In the original design we were going to use a
single administrative entry into the database and connection pooling. But,
management is concerned about tracking improper database changes if they
arise using the single user method when using the database log to track user
activity. Concern was raised if 200 users with individual access, and
connection pooling turned off would drastically affect performance. Does
connection pooling have a limitation to the number of users hitting a
particular site?

"Nick Elson" <@@@nick@@@.@@@elson@sybase@@@.@@@com@@@> wrote in message
news:487d1e37$1@forums-1-dub...
> On the pooling question, to use or not to use pooling is
> often a question of how often you are cycling connections.
> If you connect infrequently, there may be no overall
> performance benefit to pooling. Of course, there is no
> better approach than to do some of your own testing
> to get a measure on the real gains/overhead involved.
>
> In part of your second question you mentioned something
> that made me think of auditing.
>
>
> I am not familiar with LogMiner. Maybe a few
> more details about that utility's capabilities and
> more importantly the need that is being used for
> can help others respond.
>
> You might find that some of the capabilities are
> available from the cmdline. The dbtran utility
> has quite a few switches to filter the log by.
>
>
> <rpruski@esc20.net> wrote in message
> news:487c0a77.1919.1681692777@sybase.com...
>> First question, I've been given me the task to find a tool
>> for SQL Anywhere that is similar to Oracle's LogMiner.
>> Logminer easily locate database changes, enables data
>> analysis, and provides undo capabilities to rollback logical
>> data. We currently use SQL Anywhere with our client-server
>> Powerbuilder application, abut will be converting over to
>> JAVA. Previously we would translate a database log to SQL
>> to find changes within the database which is very tedious.
>> Our mainframe group uses a Oracle database and Logminer to
>> analyze or manipulate the database, which is the reason for
>> asking if there is a similar tool for SQL Anywhere.
>>
>> Second question, are there any "white papers" or information
>> on the limits, performance impact of not using SQL Anywhere
>> driver pooling? Our management team would rather not use
>> pooling and have individual signons instead of a single
>> signon for a web application. Mainly to be able to have an
>> audit trail within the database log for accountability if
>> necessary, what would performance ramifications be on a web
>> application with 200 individuals logging in without pooling?
>>
>> Thanks,
>>
>> Robert
>
>


"Nick Elson" < Posted on 2008-08-05 16:36:22.0Z
From: "Nick Elson" <@@@nick@@@.@@@elson@sybase@@@.@@@com@@@>
Newsgroups: ianywhere.public.general
References: <487c0a77.1919.1681692777@sybase.com> <487d1e37$1@forums-1-dub> <488f6fff$1@forums-1-dub>
Subject: Re: SQl Anywhere database log tools
Lines: 145
X-Priority: 3
X-MSMail-Priority: Normal
X-Newsreader: Microsoft Outlook Express 6.00.2900.2869
X-RFC2646: Format=Flowed; Response
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2962
NNTP-Posting-Host: vip152.sybase.com
X-Original-NNTP-Posting-Host: vip152.sybase.com
Message-ID: <48988186$1@forums-1-dub>
Date: 5 Aug 2008 09:36:22 -0700
X-Trace: forums-1-dub 1217954182 10.22.241.152 (5 Aug 2008 09:36:22 -0700)
X-Original-Trace: 5 Aug 2008 09:36:22 -0700, vip152.sybase.com
X-Authenticated-User: techsupp
Path: forums-1-dub!not-for-mail
Xref: forums-1-dub ianywhere.public.general:7000
Article PK: 5224


> On the pooling question we will have many as little as 25 or up to 1500
> users hitting multiple sites. . . . activity. Concern was raised if 200
> users with individual access, and connection pooling turned off would
> drastically affect performance. Does connection pooling have a limitation
> to the number of users hitting a particular site?

200 or 2000 individual users is not really the concern.
200 or 2000 connects and disconnects *** per minute ***
or *** per second *** might be more of a concern.
It is the cases where there are a high rate of connection
cycles where pooling becomes important to me.

> Basically our mainframe staff can see data changes before and after from
> the database log file. The question was raised if SQL Anywhere had a
> similar tool where you could see a before view of the data, not just data
> contained in a insert command for example. We use Sybase Central to
> translate a log file into SQL which makes tracking changes difficult.

In SQL Anywhere the transaction log is the redo log and the
facility **is** the dbtran utility.

The dbtran utility gives you much of this, sans a GUI. You
can also access the log translation API (see dbtools API) to
build a GUI tool for this but we do not currently offer such
a module and I am unaware of any 3rd party that has.

I can see how the flexibility of replaying and rolling back at will
might be of value in seeing operations but there is no such
GUI tool today.

Be sure to look into Performance Monitoring in Version 10
as well as auditing, profiling and request level logging (with
sa_get_request_profile especially in versions older than 10).


"Robert" <robert.pruski@esc20.net> wrote in message
news:488f6fff$1@forums-1-dub...
> Here is an overview of Logminer from Oracle's web site.
> LogMinerT is a powerful audit tool for Oracle databases, allowing
> administrators to easily locate changes in the database, enabling
> sophisticated data analyses, and providing undo capabilities to rollback
> logical data corruptions or user errors.
>
> LogMiner offers two interfaces:
>
> a.. A SQL interface, which calls built-in PL/SQL packages to setup a data
> dictionary, specify redo logs, and execute queries (this interface is
> applicable to SQL*Plus, command-line scripts, or custom applications).
> b.. LogMiner Viewer, an intuitive GUI which allows the administrator to
> setup a data dictionary, specify the redo logs, specify query criteria,
> and view/save redo log data.
> LogMiner can also be leveraged for:
>
> a.. Ex post facto auditing of DML statements, the order in which
> transactions were committed and the user responsible for the updates.
> b.. Historical analysis of data access patterns for database tuning and
> capacity planning.
> c.. Tracking schema evolution and the impact on data structure.
> LogMiner directly accesses the Oracle redo logs, which are complete
> records of all activities performed on the database, and the associated
> data dictionary, which is used to translate internal object identifiers
> and types to external names and data formats. Using a dynamic view
> V$LOGMNR_CONTENTS, LogMiner populates a row in this view with each logical
> operation performed on the database, thus offering familiar,
> relational-based access for ad-hoc querying or custom application
> consumption. Each row contains a SQL UNDO statement, which can be used to
> rollback the change, and SQL REDO statement, which details the original
> operation. Log analysis can be conducted with the online catalog as the
> dictionary source, or an offline dictionary that has been extracted to a
> set of relevant redo logs, or a standalone flat file. With offline
> analysis, LogMiner can be run on a separate database, using archived redo
> logs and the associated dictionary from the source database, thus
> alleviating resource consumption on the source system.
>
> Basically our mainframe staff can see data changes before and after from
> the database log file. The question was raised if SQL Anywhere had a
> similar tool where you could see a before view of the data, not just data
> contained in a insert command for example. We use Sybase Central to
> translate a log file into SQL which makes tracking changes difficult.
>
> On the pooling question we will have many as little as 25 or up to 1500
> users hitting multiple sites. In the original design we were going to use
> a single administrative entry into the database and connection pooling.
> But, management is concerned about tracking improper database changes if
> they arise using the single user method when using the database log to
> track user activity. Concern was raised if 200 users with individual
> access, and connection pooling turned off would drastically affect
> performance. Does connection pooling have a limitation to the number of
> users hitting a particular site?
>
> "Nick Elson" <@@@nick@@@.@@@elson@sybase@@@.@@@com@@@> wrote in message
> news:487d1e37$1@forums-1-dub...
>> On the pooling question, to use or not to use pooling is
>> often a question of how often you are cycling connections.
>> If you connect infrequently, there may be no overall
>> performance benefit to pooling. Of course, there is no
>> better approach than to do some of your own testing
>> to get a measure on the real gains/overhead involved.
>>
>> In part of your second question you mentioned something
>> that made me think of auditing.
>>
>>
>> I am not familiar with LogMiner. Maybe a few
>> more details about that utility's capabilities and
>> more importantly the need that is being used for
>> can help others respond.
>>
>> You might find that some of the capabilities are
>> available from the cmdline. The dbtran utility
>> has quite a few switches to filter the log by.
>>
>>
>> <rpruski@esc20.net> wrote in message
>> news:487c0a77.1919.1681692777@sybase.com...
>>> First question, I've been given me the task to find a tool
>>> for SQL Anywhere that is similar to Oracle's LogMiner.
>>> Logminer easily locate database changes, enables data
>>> analysis, and provides undo capabilities to rollback logical
>>> data. We currently use SQL Anywhere with our client-server
>>> Powerbuilder application, abut will be converting over to
>>> JAVA. Previously we would translate a database log to SQL
>>> to find changes within the database which is very tedious.
>>> Our mainframe group uses a Oracle database and Logminer to
>>> analyze or manipulate the database, which is the reason for
>>> asking if there is a similar tool for SQL Anywhere.
>>>
>>> Second question, are there any "white papers" or information
>>> on the limits, performance impact of not using SQL Anywhere
>>> driver pooling? Our management team would rather not use
>>> pooling and have individual signons instead of a single
>>> signon for a web application. Mainly to be able to have an
>>> audit trail within the database log for accountability if
>>> necessary, what would performance ramifications be on a web
>>> application with 200 individuals logging in without pooling?
>>>
>>> Thanks,
>>>
>>> Robert
>>
>>
>
>