RSS stuff

This forum is reserved for everything you want to talk about. It could be about programming, opinions, open source programs, development in general, or just cool stuff to share!
priyank_bolia
wxWorld Domination!
wxWorld Domination!
Posts: 1339
Joined: Wed Aug 03, 2005 8:10 am
Location: BANGALORE, INDIA
Contact:

Post by priyank_bolia » Fri Sep 16, 2005 5:50 pm

I agree XML processing takes much time, but the status can be added to the xml archieved, and I don't want to add a MySQL setup to the project.
1.) Licensing
2.) Size
3.) User gets annoyed having additional things installed with it.
4.) Start time of MySQL service...
5.) Microsoft based database (No way)
6.) Any other database won't make much difference, in comparison to MySQL.

Jorg
Moderator
Moderator
Posts: 3971
Joined: Fri Aug 27, 2004 9:38 pm
Location: Delft, Netherlands
Contact:

Post by Jorg » Fri Sep 16, 2005 5:50 pm

I do agree with that. Plus, IF odbc is used, even an external database or online database can be used for storage. Even a shared one where more employees can read the same article. Then ofcourse the state information needs to be in a seperate table linked to the current user ;-)

- Jorgen
Forensic Software Engineer
Netherlands Forensic Insitute
http://english.forensischinstituut.nl/
-------------------------------------
Jorg's WasteBucket
http://www.xs4all.nl/~jorgb/wb

priyank_bolia
wxWorld Domination!
wxWorld Domination!
Posts: 1339
Joined: Wed Aug 03, 2005 8:10 am
Location: BANGALORE, INDIA
Contact:

Post by priyank_bolia » Fri Sep 16, 2005 5:53 pm

I do agree with that. Plus, IF odbc is used, even an external database or online database can be used for storage. Even a shared one where more employees can read the same article. Then ofcourse the state information needs to be in a seperate table linked to the current user
Hey Jorg, we are not making a RSS CVS, RSS reader is a end user application and the idea of a online database, what difference it makes rather than downloading the RSS again. Also another list of issues with online website.....

priyank_bolia
wxWorld Domination!
wxWorld Domination!
Posts: 1339
Joined: Wed Aug 03, 2005 8:10 am
Location: BANGALORE, INDIA
Contact:

Post by priyank_bolia » Fri Sep 16, 2005 5:57 pm

Regarding Searching also, archieving different things in different package would also help a lot.

priyank_bolia
wxWorld Domination!
wxWorld Domination!
Posts: 1339
Joined: Wed Aug 03, 2005 8:10 am
Location: BANGALORE, INDIA
Contact:

Post by priyank_bolia » Fri Sep 16, 2005 6:09 pm

Seeing Ryan code, a self written xml parser, would it be good thing to use that, or use a more professional, tested, thing. As the program gots crashed each time, when compiled with VC++7.1

User avatar
ABX
Can't get richer than this
Can't get richer than this
Posts: 810
Joined: Mon Sep 06, 2004 1:43 pm
Location: Poznan, Poland
Contact:

Post by ABX » Fri Sep 16, 2005 6:11 pm

priyank_bolia wrote:Hey Jorg, we are not making a RSS CVS, RSS reader is a end user application and the idea of a online database, what difference it makes rather than downloading the RSS again. Also another list of issues with online website.....
+1 for database based solution. downloading RSS again is sometimes impossible and it is well worth to keep some of RSSes for searching. Databases support specialised solutions for searching, indexing, optimizing (including segmentation for fastes access). And why do you mention MySQL? Solution like SQLite seems reasonable.

ABX
Last edited by ABX on Fri Sep 16, 2005 7:02 pm, edited 1 time in total.
CVS Head, 2.8.X
wxMSW, wxWinCE, wxPalmOS, wxOS2, wxMGL, bakefile
gcc 3.2.3, bcc 5.51, dmc 8.48, ow 1.6, vc 7.1, evc 3/4, pods 1.2

Jorg
Moderator
Moderator
Posts: 3971
Joined: Fri Aug 27, 2004 9:38 pm
Location: Delft, Netherlands
Contact:

Post by Jorg » Fri Sep 16, 2005 6:48 pm

SQLLite is also nice. I would be in favor of a DB model also.

and as for comments on Ryan's code, please keep in mind it is created in 1 or 2 days which is quite impressive for so much functionality ;-)

Ok, it might not be tested, but it can serve as a nice showcase how a RSS reader can be made..

- Jorgen
Forensic Software Engineer
Netherlands Forensic Insitute
http://english.forensischinstituut.nl/
-------------------------------------
Jorg's WasteBucket
http://www.xs4all.nl/~jorgb/wb

User avatar
ABX
Can't get richer than this
Can't get richer than this
Posts: 810
Joined: Mon Sep 06, 2004 1:43 pm
Location: Poznan, Poland
Contact:

Post by ABX » Fri Sep 16, 2005 7:10 pm

ABX wrote:+1 for database based solution.
Oh, and I forgot that it would be great if it could be machine/filesystem-independent. Anyone who ever worked with applications like XNews knows what I mean. All files of XNews are stored in single directory and registers/congigs outside of it are not touched. This way it's easy to backup or move application from location to location (like taking it from online desktop computer to laptop for travel and offline reading) without worrying about installing anything or about missing components. Also it is easy then to have single location of application on network drive and access it from any available machine.

Ok. Just my 2 pieces of money written through RSS client :-)

ABX
CVS Head, 2.8.X
wxMSW, wxWinCE, wxPalmOS, wxOS2, wxMGL, bakefile
gcc 3.2.3, bcc 5.51, dmc 8.48, ow 1.6, vc 7.1, evc 3/4, pods 1.2

User avatar
Ryan Norton
Moderator
Moderator
Posts: 1319
Joined: Mon Aug 30, 2004 6:01 pm

Post by Ryan Norton » Fri Sep 16, 2005 11:04 pm

Jorg wrote:SQLLite is also nice. I would be in favor of a DB model also.
SQLLite is definately what you'd want to do.
[Mostly retired moderator, still check in to clean up some stuff]

priyank_bolia
wxWorld Domination!
wxWorld Domination!
Posts: 1339
Joined: Wed Aug 03, 2005 8:10 am
Location: BANGALORE, INDIA
Contact:

Post by priyank_bolia » Thu Sep 29, 2005 4:20 pm

what should be the expected man-hours for wxRSSReader, provided that one xerces, mult-threads, professional GUI, SQLite. Also I was wondering that there is no wrapper for SQLite in wxWidgets, the license conditions of wxSQLite makes is useful for nothing.

User avatar
Ryan Norton
Moderator
Moderator
Posts: 1319
Joined: Mon Aug 30, 2004 6:01 pm

Post by Ryan Norton » Sun Oct 30, 2005 6:28 am

Finally figured out why it was crashing on non-msw platforms:

Evidently you can't call wxURL::GetInputStream in a secondary thread because you can't initialize a socket a secondary thread. NASTY!
[Mostly retired moderator, still check in to clean up some stuff]

Jorg
Moderator
Moderator
Posts: 3971
Joined: Fri Aug 27, 2004 9:38 pm
Location: Delft, Netherlands
Contact:

Post by Jorg » Sun Oct 30, 2005 8:56 am

That's a real drawback :-(

sockets are just made for handling in other threads. This should really be fixed, or solved otherwise.

As for the RSS reader, I am still thinking about it. I made a small side project (RarVision) which utilizes wxSQLite3 as a test to see how DB programming actually goes. And I have to say, it is a whole different world, but very fun to do. It has some big advantages when having to maintain blocks of data, one of the obvious ones, that after sudden closes or crashes no data is usually lost.

As for the RSS reader, A DB is definately a way to go. I do not know if SQLite stores platform independent data. It should not be too hard to maintain it, as triggers make life very easy for cleanup.

All that remains with DB programming is keeping your app layer in sync, know when the underlying data is removed, or altered. That is something that really needs to be looked into..

- Jorgen
Forensic Software Engineer
Netherlands Forensic Insitute
http://english.forensischinstituut.nl/
-------------------------------------
Jorg's WasteBucket
http://www.xs4all.nl/~jorgb/wb

lowjoel
Moderator
Moderator
Posts: 1511
Joined: Sun Jun 19, 2005 11:37 am
Location: Singapore
Contact:

Post by lowjoel » Sun Oct 30, 2005 12:22 pm

@Ryan, doesn't wxSocketBase::Initialize() do wonders? Or is it just MSW?

User avatar
Ryan Norton
Moderator
Moderator
Posts: 1319
Joined: Mon Aug 30, 2004 6:01 pm

Post by Ryan Norton » Mon Oct 31, 2005 12:54 am

(there was some code here but it was huge - I moved it to a component on wxCode which should be up shortly)
Last edited by Ryan Norton on Mon Oct 31, 2005 4:57 am, edited 1 time in total.
[Mostly retired moderator, still check in to clean up some stuff]

User avatar
Ryan Norton
Moderator
Moderator
Posts: 1319
Joined: Mon Aug 30, 2004 6:01 pm

Post by Ryan Norton » Mon Oct 31, 2005 1:06 am

lowjoel wrote:@Ryan, doesn't wxSocketBase::Initialize() do wonders? Or is it just MSW?
Oh, right. Crud- that would work on mac, wouldn't it? I forgot about that erm... workaround :).
[Mostly retired moderator, still check in to clean up some stuff]

Post Reply