Adam Dickmeiss [Mon, 23 Apr 2007 08:06:21 +0000 (08:06 +0000)]
Allow any number of worker threads for sel_thread. Added optional parameter
work_destroy handler for sel_thread_create. This will only be called
sel_thread_destroy, in the case of non-empty work queues. Three resolver
threads now running - seems to make resolving many.xml slightly faster.
Adam Dickmeiss [Mon, 23 Apr 2007 07:55:23 +0000 (07:55 +0000)]
Saving seven keystrokes
Adam Dickmeiss [Mon, 23 Apr 2007 07:34:48 +0000 (07:34 +0000)]
Prefix resolved message
Adam Dickmeiss [Mon, 23 Apr 2007 07:29:34 +0000 (07:29 +0000)]
Rename test functions a bit
Adam Dickmeiss [Mon, 23 Apr 2007 07:26:15 +0000 (07:26 +0000)]
Added these target settings based on their .pz-equivalents.
Adam Dickmeiss [Mon, 23 Apr 2007 07:03:06 +0000 (07:03 +0000)]
Added ID for partintro
Adam Dickmeiss [Sun, 22 Apr 2007 16:41:42 +0000 (16:41 +0000)]
Connections now wait for hosts to be resolved. Delayed connect attempt
is handled by connect_resolver_host. All connection with bad addresses
(unresolved ones) are destroyed with connection_destroy. Connect
failures leave the connections in the open. If that's to be changed
connection_destroy should be called if connection_connect returns -1.
Sebastian Hammer [Sun, 22 Apr 2007 15:19:36 +0000 (15:19 +0000)]
Notes on implementation status of a couple of settings
Adam Dickmeiss [Sun, 22 Apr 2007 15:07:10 +0000 (15:07 +0000)]
Per-session databases and configuration. This was implemented
by Sebastian.
Adam Dickmeiss [Sun, 22 Apr 2007 15:00:56 +0000 (15:00 +0000)]
Removed load_simpletargets
Adam Dickmeiss [Sat, 21 Apr 2007 12:00:54 +0000 (12:00 +0000)]
Perform getaddrinfo in separate thread for a given struct host.
Sebastian Hammer [Fri, 20 Apr 2007 16:37:35 +0000 (16:37 +0000)]
Changed new code to use session_setting_oneval
Sebastian Hammer [Fri, 20 Apr 2007 16:21:19 +0000 (16:21 +0000)]
Made load of XSLT normalization stylesheet dynamic
Sebastian Hammer [Fri, 20 Apr 2007 15:36:48 +0000 (15:36 +0000)]
*** empty log message ***
Marc Cromme [Fri, 20 Apr 2007 14:37:17 +0000 (14:37 +0000)]
started record constructors. still unfnished, but yet only used in test_relevance.c
Sebastian Hammer [Fri, 20 Apr 2007 14:05:23 +0000 (14:05 +0000)]
Collapsing charset into native encoding. It simplifies implementation, and the
two are closely related anyway.
Jakub Skoczen [Fri, 20 Apr 2007 13:56:20 +0000 (13:56 +0000)]
problems with ajaxError catching all exceptions solved
pz2.js will now throw an exception if the protocol version is not supported
smarter error handling in general
Marc Cromme [Fri, 20 Apr 2007 13:03:22 +0000 (13:03 +0000)]
splitting record specific definition out from pazpar2.h header to record.h header, thus preparing for implementation of record constructors in the coming record.c file
Adam Dickmeiss [Fri, 20 Apr 2007 11:56:37 +0000 (11:56 +0000)]
Minor
Adam Dickmeiss [Fri, 20 Apr 2007 11:44:58 +0000 (11:44 +0000)]
Select thread system now passes a simple test using IOCHANSs.
Adam Dickmeiss [Fri, 20 Apr 2007 11:43:43 +0000 (11:43 +0000)]
Fix hard-coded 30 second limit. Unfortunately we have a lot of
these select loops around - all more or less buggy.
Adam Dickmeiss [Fri, 20 Apr 2007 11:20:16 +0000 (11:20 +0000)]
Linking with threads
Marc Cromme [Fri, 20 Apr 2007 11:00:29 +0000 (11:00 +0000)]
added metadata and sortkey assign functions (to conf_service objects)
in parse_service, seperated code in three groups: xml parsing, parsed value logic, and assignment to conf_service, using the new creator and assign functions.
Adam Dickmeiss [Fri, 20 Apr 2007 10:15:19 +0000 (10:15 +0000)]
sel_thread_result reads from pipe
Adam Dickmeiss [Fri, 20 Apr 2007 10:06:52 +0000 (10:06 +0000)]
Started work on select thread system.
Sebastian Hammer [Fri, 20 Apr 2007 04:32:33 +0000 (04:32 +0000)]
Allows definition/override of pz:cclmap:* settings via settings ws.
CCL parser allocated/deallocated on the fly at query time
Sebastian Hammer [Fri, 20 Apr 2007 04:08:14 +0000 (04:08 +0000)]
Removed query from session structure. It is no longer needed, since a pquery
is associated with each client.
Marc Cromme [Thu, 19 Apr 2007 19:44:31 +0000 (19:44 +0000)]
added ignore of session*.xml files
Marc Cromme [Thu, 19 Apr 2007 19:42:30 +0000 (19:42 +0000)]
added conf_service creator inclusive metadata and sortkey assigners, added unittests on the same as well. creators for record construction still needed
Marc Cromme [Thu, 19 Apr 2007 19:40:22 +0000 (19:40 +0000)]
restricting to non-test files
Adam Dickmeiss [Thu, 19 Apr 2007 16:07:20 +0000 (16:07 +0000)]
Refactor access to global variable channel_list. There were a few
places where this was accessed and always in the same way.
Adam Dickmeiss [Thu, 19 Apr 2007 16:06:10 +0000 (16:06 +0000)]
Tiny example update
Adam Dickmeiss [Thu, 19 Apr 2007 15:31:23 +0000 (15:31 +0000)]
Removed redundant declarations
Marc Cromme [Thu, 19 Apr 2007 11:57:53 +0000 (11:57 +0000)]
started adding conf_service and conf-metadata constructors. not finished yet, just checked in for file moving. Do not use yet
Adam Dickmeiss [Wed, 18 Apr 2007 19:50:06 +0000 (19:50 +0000)]
Ignore test_relevance program and log file
Sebastian Hammer [Wed, 18 Apr 2007 19:45:09 +0000 (19:45 +0000)]
Fixed bug 854. Using nmem_split() to split phrase terms on word boundaries.
I love nmem_split. If I were not a family man, I would ask her to marry me.
Sebastian Hammer [Wed, 18 Apr 2007 16:11:41 +0000 (16:11 +0000)]
Removed 'Masterkey' from implementation name
Marc Cromme [Wed, 18 Apr 2007 15:09:51 +0000 (15:09 +0000)]
pretty-formattting comments , now not exeeding 80 chars
Adam Dickmeiss [Wed, 18 Apr 2007 13:41:03 +0000 (13:41 +0000)]
Make Pazpar2 configure prefer static YAZ - when locally built
Sebastian Hammer [Wed, 18 Apr 2007 12:41:38 +0000 (12:41 +0000)]
I think this addresses Bug 1070.
Marc Cromme [Wed, 18 Apr 2007 07:41:03 +0000 (07:41 +0000)]
encapsulating all record fields in a xsl:for-each to prevent emitting empty
<md-title> elements. Now all emitted elements have always content, and the final web client JS does not break any more.
Sebastian Hammer [Wed, 18 Apr 2007 04:30:28 +0000 (04:30 +0000)]
Removed for now.. display of bib targets not really good enough
Sebastian Hammer [Wed, 18 Apr 2007 04:23:53 +0000 (04:23 +0000)]
Put an alert in ajaxError. This is not pretty and should be moved to the client
code.. but I am not sure how Jakub wants to handle errors in the client code.
Do we need to clean up what pazpar2 sends back?
Sebastian Hammer [Wed, 18 Apr 2007 04:22:55 +0000 (04:22 +0000)]
Search still went ahead even if one target had a parse error.. bad news.
Sebastian Hammer [Wed, 18 Apr 2007 04:07:48 +0000 (04:07 +0000)]
Oops. output of ccl_pquery not null-terminated. Added null.
Sebastian Hammer [Wed, 18 Apr 2007 03:42:29 +0000 (03:42 +0000)]
Messing with the refresh timer to make things feel snappier.
Sebastian Hammer [Tue, 17 Apr 2007 21:25:26 +0000 (21:25 +0000)]
Fixed bug 897. Pazpar2/search fails gracefully on empty queries or queries
that don't parse. This should address pretty much all of the coredumps I have seen.
Sebastian Hammer [Tue, 17 Apr 2007 17:49:41 +0000 (17:49 +0000)]
Added LOC example config
Sebastian Hammer [Tue, 17 Apr 2007 17:49:18 +0000 (17:49 +0000)]
Added LOC to MK production demo
Sebastian Hammer [Tue, 17 Apr 2007 17:48:48 +0000 (17:48 +0000)]
Added author search
Marc Cromme [Tue, 17 Apr 2007 13:30:24 +0000 (13:30 +0000)]
Still trying to relevance-rank one single record.
Bug#: 1056 struct conf_service needs conf_service_create creator
Bug#: 1057 struct record needs record_create() function
needs to be resolved first, before this unit test will progress.
to be continued tomorrow
Jakub Skoczen [Tue, 17 Apr 2007 13:12:50 +0000 (13:12 +0000)]
Added newer version of jquery (faster).
Jakub Skoczen [Tue, 17 Apr 2007 12:53:44 +0000 (12:53 +0000)]
When author link is clicked, all books by that author will be found.
Marc Cromme [Tue, 17 Apr 2007 12:15:32 +0000 (12:15 +0000)]
added five asserts to make sure that the arguments of reclist_insert do exist
Marc Cromme [Tue, 17 Apr 2007 07:52:03 +0000 (07:52 +0000)]
changed order of arguments of reclist_insert such that struct reclist *tl
now comes first, since this is the owner of the object member function
Adam Dickmeiss [Mon, 16 Apr 2007 21:54:43 +0000 (21:54 +0000)]
Another and hopefully, last, YAZ OID DB update
Sebastian Hammer [Mon, 16 Apr 2007 21:14:38 +0000 (21:14 +0000)]
Removed $Id$ again.. that seemed redundant when the protocol number is there
Sebastian Hammer [Mon, 16 Apr 2007 21:11:26 +0000 (21:11 +0000)]
Added protocol number and $Id$ to init response
Sebastian Hammer [Mon, 16 Apr 2007 20:34:17 +0000 (20:34 +0000)]
Displays empty location subrecords in brief formats.. dunno if this is useful.
Should be extended to display other sub-elements, too.
Sebastian Hammer [Mon, 16 Apr 2007 20:23:24 +0000 (20:23 +0000)]
Tuning interface. Tuning Wikipedia searching
Marc Cromme [Mon, 16 Apr 2007 13:58:20 +0000 (13:58 +0000)]
added first shot on relevance ranking testing, still incomplete and segfaulting.
Compile an run using 'make check'
Marc Cromme [Mon, 16 Apr 2007 13:57:25 +0000 (13:57 +0000)]
added asserts on service struct passed to reclist_insert
Marc Cromme [Mon, 16 Apr 2007 13:54:55 +0000 (13:54 +0000)]
added
assert(service);
assert(service->num_metadata);
assert(service->num_sortkeys);
Marc Cromme [Mon, 16 Apr 2007 13:22:17 +0000 (13:22 +0000)]
removed global parameters from reclist_insert()
Adam Dickmeiss [Mon, 16 Apr 2007 09:07:57 +0000 (09:07 +0000)]
Using convenience library libpazpar2.a now.
Adam Dickmeiss [Mon, 16 Apr 2007 09:03:25 +0000 (09:03 +0000)]
main() in pazpar2.c . Rest of high-level logic moved to logic.c. Some
external definitions moved to pazpar2.h.
Sebastian Hammer [Sun, 15 Apr 2007 06:57:22 +0000 (06:57 +0000)]
Moved masterkey-specific settings to separate dir. Tuned config of
wikipedia to be more narrow.
Sebastian Hammer [Sun, 15 Apr 2007 03:26:47 +0000 (03:26 +0000)]
Added locaton info to the output of the show command.
Sebastian Hammer [Sun, 15 Apr 2007 03:24:18 +0000 (03:24 +0000)]
Experimentally added display of database names after each hit
Sebastian Hammer [Sun, 15 Apr 2007 00:35:57 +0000 (00:35 +0000)]
Modified http_create. Used a per-request nmem structure to allocate space for the
address. Changed this to a constant-size buffer.
Sebastian Hammer [Sat, 14 Apr 2007 23:59:20 +0000 (23:59 +0000)]
Removed linechange before first location
Sebastian Hammer [Sat, 14 Apr 2007 06:14:28 +0000 (06:14 +0000)]
Evolving config for masterkey service -- different processing of data field from standard
file.
Sebastian Hammer [Sat, 14 Apr 2007 06:12:21 +0000 (06:12 +0000)]
Messing with the full display to bring it closer in line with what is needed
for masterkey service. Not there yet.
Sebastian Hammer [Sat, 14 Apr 2007 06:11:47 +0000 (06:11 +0000)]
Hack to disable the snagging of normal Javascript errors. There must be a
better way of doing this.
Sebastian Hammer [Fri, 13 Apr 2007 18:28:10 +0000 (18:28 +0000)]
Fixed disappearing records.
Sebastian Hammer [Fri, 13 Apr 2007 17:19:53 +0000 (17:19 +0000)]
Introduced a check for empty value in record processing
Sebastian Hammer [Fri, 13 Apr 2007 16:06:08 +0000 (16:06 +0000)]
Simple query should not put "" around terms. It messes with CCL and-list logic
Marc Cromme [Fri, 13 Apr 2007 11:13:08 +0000 (11:13 +0000)]
added initialization of char *recsyn = 0; and char *piggyback = 0;
added iconv query encoding according to the target's setting, assuming that pazpar2 internal encoding is always UTF-8.
This gives _much_ nicer record matches in the Greek UOC project!
Sebastian Hammer [Fri, 13 Apr 2007 03:30:19 +0000 (03:30 +0000)]
Minor
Sebastian Hammer [Fri, 13 Apr 2007 02:20:07 +0000 (02:20 +0000)]
Setup stand-alone config for ID Open Content resources
Sebastian Hammer [Fri, 13 Apr 2007 01:55:09 +0000 (01:55 +0000)]
Complete configuration for local test server access. Replaces test.pz
Sebastian Hammer [Fri, 13 Apr 2007 01:48:22 +0000 (01:48 +0000)]
Modified settings system to read single file or directory, depending on settings
node in config or -t override. Use, e.g. to start with -t testserver.xml which
contains complete configuration for local yaz-ztest
Sebastian Hammer [Fri, 13 Apr 2007 01:10:21 +0000 (01:10 +0000)]
Added hitcount after resource name
Sebastian Hammer [Fri, 13 Apr 2007 00:53:08 +0000 (00:53 +0000)]
Removed old-style CCL config files
Sebastian Hammer [Fri, 13 Apr 2007 00:29:14 +0000 (00:29 +0000)]
Bad pointer assignment in prepare_yazmarc
Adam Dickmeiss [Thu, 12 Apr 2007 13:46:28 +0000 (13:46 +0000)]
Prepare for YAZ 3s new OID system
Marc Cromme [Thu, 12 Apr 2007 12:05:22 +0000 (12:05 +0000)]
added logging of searchRequest RPN query for debugging
might get removed later again when logs grow too much
Marc Cromme [Thu, 12 Apr 2007 11:35:08 +0000 (11:35 +0000)]
adding settings field 'pz.queryencoding'
now need to do something with it ..
Marc Cromme [Thu, 12 Apr 2007 10:17:53 +0000 (10:17 +0000)]
removed break statement - actually _using_ the specified target
encoding to initiate an yaz_iconv_t object,
now yaz_marc_iconv(db->yaz_marc, cm) converts to UTF-8 marc records,
and XML conversion is fine
Marc Cromme [Thu, 12 Apr 2007 09:59:47 +0000 (09:59 +0000)]
added logging of target name when XML normalization failed
using libxml2 switch for marc-to-XML conversion
added more tests to assure that output of XSLT transformation is valid XML
Marc Cromme [Thu, 12 Apr 2007 07:15:48 +0000 (07:15 +0000)]
avoid loading ZeeReX if no config->targetprofiles is defined
Sebastian Hammer [Wed, 11 Apr 2007 20:00:18 +0000 (20:00 +0000)]
Simple target file with econtent sites -- Only sets a name for each -- assumes
that reasonable defaults are set elsewhere.
Sebastian Hammer [Wed, 11 Apr 2007 19:55:57 +0000 (19:55 +0000)]
Removed 'user' from settings structure and code..
Sebastian Hammer [Wed, 11 Apr 2007 18:42:25 +0000 (18:42 +0000)]
Major change. Targets are now created when they are referred to in the settings
system. This means that the .pz files are no longer needed. HOWEVER, for
consistency & power, database name is now a setting, pz:name. The names in the .pz
files are ignored. .pz-files should be converted to simple settings files.
Sebastian Hammer [Wed, 11 Apr 2007 16:48:09 +0000 (16:48 +0000)]
Moved the check for PZ_ALLOW
Jakub Skoczen [Wed, 11 Apr 2007 15:27:35 +0000 (15:27 +0000)]
Update following changes made to the pz2's protocol.
id -> pz:id
Sebastian Hammer [Wed, 11 Apr 2007 13:27:06 +0000 (13:27 +0000)]
Neglected to initialize session->databases
Sebastian Hammer [Wed, 11 Apr 2007 13:05:50 +0000 (13:05 +0000)]
Fixed bad dereferencing of null settings
Marc Cromme [Wed, 11 Apr 2007 11:22:35 +0000 (11:22 +0000)]
freeing XML doc pointer after usage, otherwise we have a memory leak
Marc Cromme [Wed, 11 Apr 2007 11:13:46 +0000 (11:13 +0000)]
added assert to prevent segfault by dereferencing void pointer 'settings'